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A3STRnCT 


A  comparative  evaluation  nas  been  undertaken  or.  the 
DDC  Retrieval  and  Indexing  Terminology  (DRIT)  and  the 
Thesaurus  of  Engineering  and  Scientific  Terms  (TEST). 
The  study  examined  the  hierarchic  structure  of  both 
thesauri  and  their  lead  in  terminologies,  and  the 
specificity  of  terms  in  each  thesaurus  was  compared. 

A  comparison  was  made  of  the  index  terms  assigned  to 
a  number  of  abstracts,  using  each  thesaurus,  and  these 
terms  were  also  compared  with  free  language  terms 
assigned  by  the  ASSASSIN  computer  program.  It  was 
found  that  TEST,  with  its  greater  number  of  preferred 
terms,  was  the  more  specific  indexing  terminology, 
but  DRIT  gave  the  better  guide  to  the  selection  of  a 
preferred  term  by  virtue  of  its  larger  number  of  lead 


in  terms 
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Introduction 


Technical  reports  held  by  the  Defence  Researcr.  Information  Centre 
(DRIC)  are  indexed  using  descriptors  selected  froir.  the  Engineers 
Joint  Council  -  Department  of  Defense  Thesaurus  of  Engineering  and 
Scientific  Terms  (TEST)  (l8). 

Occasionally  the  need  arises  to  index  a  concept  which  is  not  inclu¬ 
ded  in  TEST's  structure,  neither  as  a  preferred  term  nor  as  a  term, 
with  a  USE  reference.  In  these  circumstances  three  courses  of 
action  are  open  to  DRIC  indexing  staff.  First  of  all  an  existing 
TEST  term  may  be  used  if  it  can  be  considered  a  synonym  for  the 
required  concept,  or  at  least  is  related  to  it  in  some  way,  and 
will  describe  the  concept  sufficiently  for  the  purposes  of  retrieval 
If  this  procedure  is  considered  inadequate  then  groups  of  two  or 
three  descriptors  may  be  assigned  on  a  precoordination  basis.  When 
this  expedient  fails,  DRIC  indexers  discuss  the'  need  for  a  new 
descriptor  and  introduce  a  new  term  into  the  system,  if  this  is 
agreed  to  be  necessary. 

In  197^  the  preliminary  edition  of  the  DDC  Retrievel  and  Indexing 
Terminology  (DRIT)  (15)  was  published,  together  with  an  addendum 
containing  the  hierarchical  structure  of  the  thesaurus  (16).  This 
publication  aroused  immediate  interest  in  DRIC  especially  as  it  was 
learned  that  there  were  no  plans  to  up-date,  or  issue  addenda  to 
TEST.  It  was  thought  that  DRIT,  being  a  more  recent  publication, 
might  perhaps  handle  new  concepts  more  adequately  than  TEST,  and 
may  even  be  a  possible  replacement  for  TEST. 

The  most  obvious  feature  of  DRIT  is  the  predominance  of  terms 
having  a  USE  reference,  and  the  use  of  precoordination  to  describe 
concepts  which  are  not  represented  by  a  single  descriptor.  This 

_  -  -  ...  _ 


suggested  that  DRIT  may  be  a  useful  guide  to  precoordination,  ar.d  it. 
some  cases  it  has  been  possible  to  precoordiriate  terms  from  TEST 
by  referring  to  DRIT  to  determine  whether  it  handles  the  required 
concept  and  in  what  way. 

The  first  edition  of  DRIT  (17)  was  published  in  January  1975  in 
two  volumes,  with  the  hierarchical  structure  included  in  volume  2 
and  not  published  separately  as  with  the  preliminary  edition.  With 
the  publication  of  this  edition  it  was  decided  to  evaluate  the 
TEST  thesaurus  against  DRIT,  using  the  following  terms  of  reference 
as  a  broad  guide  to  the  investigation: 

1  Determine  which  thesaurus  has  the  more  specific  indexing 
terminology,  and  gives  the  better  guidance  to  the  selection  of 
preferred  indexing  terms,  expecially  for  new  concepts. 

\ 

2  Determine  which  thesaurus  produces  the  better  retrieval 
results  on  DRIC's  holdings. 

3  Outline  any  problems  which  may  arise  if  TEST  is  replaced 
by  DRIT,  ie  how  compatible  are  the  two  systems? 

As  both  thesauri  are  multidisciplinary  it  was  decided  to  restrict 
the  study  tothe  field  covered  by  the  COSATI  subject  area  of  Military 
Science.  Equivalent  hierarchical  structures  from  each  thesaurus 
were  selected  from  this  subject  area  and  their  structural  characteris 
tics  were  compared.  Also  terms  from  these  hierarchies  were  examined 
for  specificity.  To  augment  the  latter  work  documents  were  indexed 
using  each  thesaurus  and  the  index  terms  from  each  system  were 
compared,  and  the  compatibility  of  the  two  thesauri  was  determined 
from  this.  Alongside  this  study  the  documents  were  also  indexed 


;•  LX  Retrieval  and  Indexing  Terminology  ( LRIT  / 

Tne  first.  ecition  of  DRIT  is  in  two  volumes  ar.c  contains  Vr,9 
pages  of  indexing  terms  plus  a  hierarchy  (1?).  Tnere  is  iw 
incicacior.  of  now  many  terms  are  presented,  so  the  first  task  w a: 
to  determine  this.  Table  1  (see  Appendix  1)  shows  tne  calcula¬ 
tion,  wr.ich  gives  e  total  of  91.970  entries,  of  which  just  1G,i9; 
are  preferred  terms  leaving  a  massive  total  of  81,772  terms  with  a 
US E  reference.  This  gives  a  ratio  o^  1:9  preferred  terms:  lead  lr. 
terms.  TEST  has  17,810  preferred  terms  and  5,5.94  USE  terms,  giving 
a  ratio  of  1 : 1 . J preferred  terms: lead  in  terms. 

As  taDie  1  shows,  the  calculation  of  the  number  of  terms  in  DRIT 
was  made  by  counting  the  number  of  terms  on  20  pages  selected  at 
random  throughout  the  thesaurus,  followed  by  simple  aritnmetic. 

The  first  and  most  obvious  comparison  between  the  two  tnesauri  is 

x 

that  TEST  has  the  greater  number  (74.6»  more  than  DRIT)  of 
preferred  terms,  while  DRIT  is  overwhelmed  with  lead  in  terms.  These 
terms  in  DRIT,  however,  include  such  things  as  spelling  variations 
and  the  use  of  hyphens.  For  example;  the  preferred  term  in  DRIT 
is  SURFACE  TO  AIR  MISSILES,  but  lead  in  terms  for  tnis  descriptor 
include  GUIDED  MISSILES  (SURFACE  TO  AIR),  SAM,  SAMS,  SURFACE-TO-AIR 
MISSILES,  SURFACE  TO  AIR  MISSILE  and  SURFACE-TO-AIR  MISSILE  (both 
the  latter  being  singular  terms,  while  the  preferred  term  is  plural.) 

Many  of  the  USE  references  in  DRIT  refer  the  user  to  more  than  one 
preferred  term,  for  example,  Nuclear  weapon  effects  USE  Nuclear 
weapons  and  Weapons  effects.  This  use  of  precoordinstion  forms  the 
basis  of  many  of  the  USE  references  in  DRIT. 


Literature  Review 


*..*  The  Nature  of  Relations  between  Terms 

Relations  between  terms  are  divided  into  two  types,  paradigmatic 
and  syntagmatic.  Foskett  (23)  defines  paradigmatic  relation- 
snips  as  those  which  are  known  in  advance  of  scanning  a  particu¬ 
lar  document,  and  syntagmatic  relationships  as  those  whicn  are 
found  only  by  scanning  the  document. 

Paradigmatic  relationships  show  the  various  aspects  of  genus- 
species  relation  and  form  the  basis  of  hierarchical  structures 
and  other  relations,  while  syntagmatic  relationships  are  those 
which  give  rise  to  synthesis.  For  example,  tne  combination  of 
the  terms  Heat  treatment  and  Aluminium  forms  a  syntagmatic 
relationship  which  indicates  tne  subject  "heat  treatment  of 
aluminium".  From  this  it  can  be  seen  that  >syntagmatic  relations 
are  directional,  the  combination  of  Aluminium  and  Heat  treat¬ 
ment  is  not  the  same  as  the  first  combination.  This  direc¬ 
tionality  of  syntagmatic  relations  becomes  more  obvious  in  the 
two  headlines  "Dog  Bites  Man"  and  "Man  Bites  Dog". 

Stokolova  (?1)  defines  the  functions  of  paradigmatic  relations 
such  as  consequence  — ^  cause  and  material  or  process— ^propertie 
or  characteristics  as  being  analogous  to  the  function  of  tne 
relations  species— genus.  This  latter  relation  appears  in 
thesauri  as  Broad  Term— ^Narrow  Term  (BT— *NT),  ie  the 
hierarchic  structure  of  the  thesauri,  while  the  cause— ^con¬ 
sequence,  whole— ^part  and  materiai-^property  relatione  form 
the  cross  references  or  Related  terms  (RT).  Whole-Part  relation 
are  sometimes  in  evidence  in  hierarchic  relations  also. 


Gilchrist  (24)  defines  syntagma  tic  relations  as  those  Mold¬ 
ing  between  elements  forming  serial  structures  at  a  given 
level,  referable  to,  thoug.n  not  identical  witn,  tne  temporal 
f,ov  of  utterance  or  linear  stretcher,  of  writing.  As  ar. 
example  he  quotes  the  topic  "Effect  of  fertilizer  on  tne 
Vitamin  B  content  of  Wheat"  in  which  tne  three  principal 
concepts,  fertilizer,  vitamin  B  and  wheat  are  syntagmatical iy 
related. 

3.2  Comparison  and  Evaluation  of  Thesauri 

Very  little  work  has  actually  been  performed  on  evaluating 

one  thesaurus  against  smother.  Willets ( ?6)  examined  the  relation 

between  terms  in  thesauri  and  compared  the  ways  in  whicn  tnese 

relationships  are  derived  in  10  different  thesauri.  No  consis- 

> 

tent  patterns  were  found  between  the  thesauri  in  the  use  of 
related  terms  (RT).  Hierarchic  relations,  broad  and  narrow 
terms  (BT,  NT),  were  mainly  based  on  generic  and  part-whole 
relations.  Willets  also  found  that  scope  notes  and  paren¬ 
thetical  qualifiers  were  used  in  most  of  the  thesauri  where 
necessary  to  clarify  meaning. 

Subramanyam  (72)  outlines  his  criteria  for  comparing  tnesauri 
and  then  simply  rates  each  thesaurus  against  these  criteria, 
with  the  rider  that  not  all  criteria  are  applicable  in  each 
case.  Subramanyam' s  criteria  are  given  under  the  broad  head¬ 
ings  Facet  analysis,  Terminology  Control  and  Notation. 

Vickery  (75)  outlines  criteria  for  comparison  of  indexing 
terminologies 'in  more  detail: 


(1)  What  is  the  basic  form  of  the  terminology  - 
alphabetic  or  systematic? 

(2)  How  is  an  individual  ten.  focated  in  tne  scneme? 

(3)  How  many  terms  are  there  in  the  scheme? 

(4)  How  specific  are  the  terms?  (Tnis  is  &  relative 
question. ) 

(5)  Does  the  terminology  include  compound  terms, 
phrases  of  two  or  more  words,  and,  if  so,  are  tnere 
rules  governing  their  admission? 

(6)  To  what  extent  are  word  forms  (singular  and  plural, 
words  with  the  same  root)  confounded  or  kept  separate? 
Are  there  rules  governing  this? 

(7)  How  are  homographs  of  different  meaning  treated? 

(8)  Is  the  use  of  some  terms  limited  by  scope  notes 
or  definitions? 

(9)  Toiiiat  extent  are  synonyms  and  near-synonyms 
confounded? 

(10)  If  synonyms  and  near-synonyms  are  barred,  are  they 
listed  in  the  terminology  as  lead  in  words?  How  many 
such  lead  in  words  are  there? 

(11)  Are  links  made  between  a  general  term  and  those 
specific  to  it?  If  so,  what  is  the  average  number  of 
links  in  a  hierarchy?  How  many  terms  on  average  are 
linked  into  a  single  hierarchy?  To  what  extent  do  terms 
form  part  of  more  than  one  hierarchy? 


(12)  Are  links  made  between  terms  reiptec  ir.  ways  nth" 
tnan  genus  to  species?  What  otner  relations  are 
included? 

(1J)  Ho v/  are  links  between  terms  displayed?  What  is  the 
average  number  of  links  per  term? 

(14)  If  coding  is  used,  what  purpose  does  it  serve? 

This  methodology  covers  all  Subramanyam' s  criteria,  but  doer 
not  indicate  how  to  measure  specificity.  As  Vickery  indi-etes 
(see  point  4  above)  tnis  is  a  relative  question.  A  methoc  of 
comparing  classification  systems  by  comparing  the  specificity 
of  the  systems  is  described  by  Hopker  (27).  Hopker's  met  nod  ir 
to  order  each  class  in  a  group  according  to  rank  and  class 
size.  The  rank  of  a  class  is  determined  by  fin  arbitrary 
method  of  counting  the  number  of  terms  in  that  class  which 
have  a  given  number  of  terms  beneath  them  in  the  classification 
scheme.  Hopker's  arbitrary  number  of  terms  is  10.  The  class 
with  the  highest  number  of  such  terms  is  assigned  a  rank  of 
1,  the  next  highest  2  and  so  on.  A  graph  of  class  size  against 
rank  plotted  for  the  classification  systems  being  compared  will 
in  this  way  allow  a  direct  comparison  of  specificity. 

Although  this  method  of  comparison  is  completely  arbitrary, 
all  the  systems  being  compared  are  subjected  to  the  same  degree 
of  arbitrariness,  so  Vickery's  question  of  relativity  does  not 
arise. 

Although  Hopker's  method  was  applied  to  classification  systems, 
it  can  be  used  on  the  hierarchical  structure  of  thesauri.  As 
these  hierarchies  tend  to  be  smaller  than  classification  schemes, 
the  arbitrary  figure  needs  to  be  lower. 


3.’  Comparison  of  Indexing  Language  Performance 

The  most  common  method  of  comparing  indexing  languages  is  to 
measure  their  performance  in  information  retrieval.  Preci¬ 
sion  and  recall  are  often  used  as  tne  yardsticks  by  which 
performance  is  measured  ( 7 »  0,  24,  46,  53.  64,  66,  ?4)  while 
links,  roles  and  other  factors  are  introduced  tc  assess 
their  effect  on  these  yardsticks  (46,  47,  53,  66,  74). 

Much  of  the  practical  work  in  this  field  has  not  compared 
like  with  like.  Montague  (48)  compared  two  coordinate 
indexing  systems  and  a  classification  scheme,  and  found  that 
the  coordinate  indexing  systems  permitted  quicker  retrieval 
and  produced  more  relevant  references  than  did  tne  classifica¬ 
tion  scheme. 

\ 

Cleverdon  (7)  in  the  first  Cranfield  test  compared  Facet 
Analysis,  UDC,  Uni terms  (a  free  text  indexing  language  system) 
and  alphabetical  subject  headings.  In  this  test  Cleverdon 
found  that  the  alphabetical  subject  headings  produced  the  most 
efficient  system,  but  the  specificity  of  the  terms  was 
important.  However,  in  later  tests  (8)  Cleverdon  et  al  found 
that  a  natural  language  system  was  more  effective  than 
controlled  terms.  For  the  natural  language  system  normalised 
recall  was  65. 00  per  cent,  while  the  best  figure  for  controlled 
terms  was  61.76  per  cent.  In  practise  these  figures  are  so 
close  together,  that  to  say  one  system  is  better  than  the  otner 
is  a  subjective  evaluation. 


Operating  System?  Inc  ( ^>Q )  evaluated  structured  f.nc  tree 
text  searching  of  the  NHT3A  Data  Base.  Tne-ir  results  sno* 
that  there  is  no  significant  difference  in  retrieval  effective¬ 
ness  of  tne  two  systems,  but  the  i ree  text  system  nac  consider¬ 
able  advantages. 

Salton  (65)  achieved  better  retrieval  results  with  his  SMART 
system  of  automatic  text  processing  than  he  did  with  a  conven¬ 
tional  controlled  terminology  retrieval  system  (MEDLARS).  Tne 
initial  precision  and  recall  figures  using  (ij  the  SMART  auto¬ 
matic  discriminator  dictionary  and  (ii)  the  SMART  thesaurus 
were  close  to  the  figures  for  the  MEDLARS  search.  User  feed¬ 
back  caused  a  significant  increase  in  these  figures  for  both  t.n< 
SMART  systems,  but  the  difference  between  the  two  sets  of 
figures  was  small,  so  that  Salton  concluded  that  no  technical 
justification  appears  to  exist  for  maintaining  controlled  manual 
indexing  in  operational  retrieval  environments.  However,  no 
feedback  procedures  were  attempted  on  the  MEDLARS  system,  as 
this  facility  was  not  built  into  the  process.  This  in  effect 
gave  a  biassed  result  in  favour  of  the  SMART  system  and  one 
wonders  what  the  results  would  be  if  equivalent  feedback 
procedures  had  been  used  on  MEDLARS  to  allow  a  fair  comparison 
of  the  two  systems. 

Hutchins  (3"0  asserts  that  natural  languages  perform  as  well 
as,  and  sometimes  better  than  controlled  languages  in  informa¬ 
tion  retrieval.  But  he  maintains  that  it  is  ar.  open  question 
as  to  why  this  is  so.  Lancaster  (4p)  gives  more  positive 
reasons  for  this  by  pointing  out  that  an  uncontrolled  vocabu¬ 
lary  can  be  more  specific  than  a  controlled  vocabulary  in 


searching,  as  particular  concepts  can  be  searched  rather  than 
general.  As  an  example  Lancaster  offers  the  term  Lung  diseases 
as  a  generic  tens  under  whicn  a  thesaurus  may  subsume  all 
terms  for  specific  lung  diseases,  thus  losing  the  capability 
of  retrieving  only  documents  relating  to  a  specific  disease. 

Lancaster  also  states  that  a  natural  language  system  will  nave 
great  flexibility  in  searching,  since  any  term,  class  whicr.  is 
formed  at  the  input  stage  (cy  control  of  synonyms  or  establish¬ 
ing  of  nierarchies)  can  equally  well  be  formed  at  the  time  cf 
searching.  According  to  Lancaster,  tnis  means  that  a  controlled 
vocabulary  can  be  developed  wnich  is  only  used  as  a  searching 
aid.  He  further  states  that  any  existing  thpsaurus  is  poten¬ 
tially  of  value  in  a  natural  language  search. 

Hutchins  (3-')  agrees  that  some  form  of  vocabulary  control  is 
useful. 

Lancaster  (46)  points  out  that  the  flexibility  of  being  able 
to  form  classes  at  the  time  of  searching  is  lost  to  a  controlled 
vocabulary  because  the  classes  will  be  rigidly  established  by 
the  vocabulary’s  structure. 

To  evaluate  the  effectiveness  of  a  system,  Keith  (36)  points  out 
that  it  is  necessary  to  consider  the  operational  characteristics 
of  the  system  relative  to  the  information  needs.  The  probabi¬ 
lity  that  a  system  will  have  exactly  the  characteristics  the 
user  requires  is  low,  and  tne  answer  will  have  to  be  a  compromise 


9.4  Tne  Intermediate  Lexicon  and  Thesaurus  Reconciliation 

Incompatibilities  between  tnesaural  systems  arise  from  ci  flerer.- 
ces  in  trie  selection  and  form,  of  the  keywords  used  in  the 
different  systems.  Two  methods  of  relating;  one  thesaurus  to 
another  have  been  developed. 

Horsneii  (28)  describes  the  Intermediate  Lexicon,  a  switcning 
language  device  which  facilitates  the  exchange  of  suDject 
information  between  different  centres  using  different  thesauri, 
the  Intermediate  Lexicon  being  used  to  relate  equivalent  terms 
in  different  thesauri. 

The  use  of  switching  languages  such  as  the  Intermediate  ^exicor. 
is  described  by  Coates  (9).  All  terms  in  one  tnesaurur  are  reia 
ted  to  an  equivalent  notation  in  the  switching  language,  and  by 
this  to  equivalent  terms  in  all  other  thesauri  related  to  trie 
intermediary. 

A  similar  end  is  sought  by  Neville  (96,  97)  by  means  of  Thesauru 
Reconcilliation.  This  again  relates  terms  to  their  equivalents 
in  different  thesauri,  but  without  the  use  of  an  intermediary. 
The  necessary  coding  is  applied  to  the  terms  ir.  each  thesaurus 
in  the  system. 

Both  these  systems  are  related  to  tne  present  work  in  tnat 
they  both  seek  equivalence  between  tnesauri,  and  boti;  couiri 
form  the  basis  of  an  evaluation  scheme.  As  well  as  comparinc 
one  thesaurus  to  another  on  the  basis  of  equivalent  terms,  both 
the  Intermediate  Lexicon  and  Thesaurus  Reconcilliation  schemes 
would  highlight  other  areas,  such  as  where  a  term  in  one 
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tnesaurus  does  not  appear  in  antoner.  In  tnis  way  tne  decree 
of  compatibility  oetween  the  thesauri  couxd  be  ascertained. 

The  degree  of  equivalence  between  the  thesauri  would  be  a  use¬ 
ful  guide  to  the  comparison  of  the  structure  of  thesauri,  and 
to  the  specificity  of  terms.  Thus  one  term,  in  one  thesaurus 
may  appear  as  a  USE  reference  ir.  anotner,  this  USE  reference 
being  a  more  generic  term.  Both  the  Intermediate  Lexicon  and 
Thesaurus  Reconcilliatipr.  indicate  such  occurrences. 

3.5  Thesaural  versus  Free  Text  Indexing 

There  are  arguments  for  and  against  both  thesaural  and  free 
text  systems.  McArther  (50)  maintains  that  the  major  defect 
in  thesauri  is  grouping  without  adequate  contrasting  definition 
within  groups,  and  that  their  major  virtue  is  that  they  contain 
some  attempt  at  association  of  ideas,  primarily  on  principles 
of  inclusion,  synonymy  and  antonymy. 

Natural  language  usage  is  more  common  in  automated  systems,  as 
in  the  work  of  Klingbiel  (39)  and  Montgomery  (5*0« 

Aitcheson  and  Gilchrist  (l)  point  out  at  once  the  advantages  find 
disadvantages  of  free  text  indexing.  It  makes  life  simple  at 
the  indexing  stage,  but  introduces  problems  in  retrieval, 
because  the  searcher  must  allow  for  all  variations  and 
synonyms  of  the  indexing  term  in  question. 

The  National  Technical  Information  Service  (NTIS)  (55)  maintain 
that  a  controlled  vocabulary  is  important  for  information 
retrieval,  to  such  an  extent  that  a  new  microthesaurus  in  the 
field  of  environmental  science  was  created  for  use  on  the  NTIS 


data  base.  Previously,  to  searcn  this  particular  subject  area, 
it  was  necessary  to  use  not  only  free  language  terms,  but 
keywords  from  four  tnesauri  -  these  being  the  Department  of 
Defense  thesaurus,  the  Energy  Research  anc  Development 
Administration  thesaurus,  the  National  Aeronautic  and  Space 
Administration  (NASA)  thesaurus  arc  a  controlled  free  language 
list.  The  new  micro thesaurus  was  evolved  to  cope  with  tnis 
problem  and  integrates  hierarchically  the  vocabulary  of  the 
different  sources  to  allow  easier  retrieval  of  environmental 
reports. 

Pickford  (60)  points  out  that  structuring  can  be  as  simple 
as  an  alphabetic  listing.  Moving  on  from  here,  Pickford 
argues  that  a  structured  thesaurus  should  produce  consistency 
of  indexing  and  aid  search  formulation,  but  that  using  an 
unstructured  system  can  lead  to  economy  in  terms  of  minimal 
intellectual  effort,  and  simplicity  for  certain  classes  of 
user,  eg  non  information  workers. 

Other  arguments  put  by  Pickford  for  structuring  are  that: 

(i)  it  leads  to  consistency  of  indexing,  but  it 
has  been  challenged  that  this  is  a  good  thing; 

(ii)  it  aids  search  formulation; 

(iii)  it  can  serve  as  a  memory  aid; 

(iv)  it  acts  as  a  guide  to  the  use  and  understanding 
the  information  system. 

Pickford  also  describes  problems  that  have  arisen  by  using 
unstructured  languages,  the  biggest  problem  being  the  difficulty 
in  formulating  searches  because  the  inconsistency  of  indexing 
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means  tnat  users  have  to  look  in  several  places  for  their 
search  terms.  This  is  exactly  the  problem  encountered  bv 
NTIS  (55)  above. 


The  opposite  view  is  expressed  by  Farradane  et  al  (22)  who 
say  that  using  a  structured  system  of  storing  information 
for  later  retrieval  car.  lead  to  situations  in  which  relevant 
items  are  not  retrieved  because  of  technicalities  of  tne 
system. 


The  DDC  Retrieval  and  Indexing  Terminology  (14)  grew  from  an 
unstructured  data  base.  The  growth  of  this  Natural  Language 
Data  Base  (NLDB),  is  described  in  reports  by  McCauley  (5')  and 
Klingbiel  (44,  45).  Alongside  this  work  a  technique  for 
machine  aided  indexing  using  the  NLDB  has  been  developed.  Tnis 
is  also  described  in  several  reports  by  Klingbiel  (3&,  59,  40, 
41,  42,  43). 


Klingbiel  maintains  that  for  information  retrieval  highly 
structured  controlled  vocabularies  are  obsolete  and  the  natural 
language  of  scientific  prose  is  fully  adequate  for  this 
purpose  (39). 


3.6  Structure,  Development  and  Maintenance  of  a  Thesaurus 


The  word  thesaurus  has  been  defined  in  several  different  ways. 
Davis  (12)  feels  that  the  word  now  often  means  nothing  more  than 
an  alphabetical  listing  of  computer  terms,  while  Hines  and 
Harris  (26)  feel  that  a  thesaurus  is  an  indexing  language,  ratner 
than  a  glossary  or  dictionary  of  a  field.  Gilchrist  (24)  offers 
a  definition  which  helps  to  distinguish  between  a  thesaurus  and 


an  information  retrieval  or  indexing  language  term  list.  A 
thesaurus  is  an  authority  file  whicn  can  lead  the  user  from 
one  concept  to  another  via  various  heuristic  or  intuitive 
paths.  A  term  list  is  simply  an  authority  file  which  presents 
a  straight  list  of  terms.  Gilchrist  quotes  Howerton's  defini¬ 
tion  of  an  authority  file  as  being  a  structured  collection  of 
concept  descriptions  by  means  of  which  a  body  of  knowledge  is 
classified,  controlled  ‘and  searched  (29)*  As  Pickford  (60) 
points  out,  structuring  can  be  as  simple  as  alphabetic  listing. 

Pickford  (59)  also  defines  the  difference  between  an  information 
retrieval  language  and  a  thesaurus.  The  first,  he  maintains,  is 
simply  what  it  says  it  is  -  a  language  for  use  in  the  retrieval 
of  information,  and  can  be  thought  of  as  a  list  of  descriptors 
which  cover  a  particular  subject  area.  A  thesaurus  however  is 
a  complex  lexicon,  comprising  both  an  indexing  and  information 
retrieval  tool,  which  includes  not  only  a  list  of  keywords  but 
a  guide  to  the  use  of  the  keywords. 

In  his  model,  Turski  (73)  assumes  that  in  a  thesaurus,  no  two 
descriptors  are  synonyms  and  that  for  each  unrequired  term  there 
is  a  synonymous  descriptor.  This  ideal  situation  is  unlikely 
to  be  achieved  in  practise  because,  as  Aitcheson  and  Gilchrist 
point  out  (1),  many  words  have  synonyms  which  are  localised  in 
their  use,  and  some  synonyms  are  simply  out  of  date  termino¬ 
logies,  6uch  as  the  electrical  term  "capacitor"  which  has 
replaced  the  earlier  term  "condenser".  A  lead  in  terminology 
cannot  take  all  such  variations  into  account  without  becoming 
unwieldy. 


Subramanyam  (72),  Braun  and  Schwind  (6)  anc  Roiling  (C~)  all 
state  that  the  basic  function  of  a  tnesaurus  is  to  bring 
together  the  language  of  the  author,  tne  indexer  and  tne 
enquirer. 

Lancaster  (46)  takes  the  view  that  a  controlled  vocabuxary 
exists  primarily  to  control  synonyms,  near  synonyms  anti  nomo¬ 
graphs,  and  to  provide  sufficient  hierarcnicai  structure  to 
allow  the  conduct  of  generic  searcnes.  Lancaster  also  feels 
that  a  controlled  vocabulary  must  be  synthetic,  ie  provide 
facilities  for  combining  terms  to  represent  any  suoject.  The 
same  requirements  are  outlined  by  Jones  (33)  and  Soergel  (66) 
who  also  takes  tne  view  that  homographs  and  homonyms  as  well  as 
synonyms  must  be  catered  for. 

Tne  importance  of  controlling  synonyms  has  been  demonstrated  by 
Bottle  (5)  and  others.  In  studies  Bottle  found  that  one  tnird 
or  more  of  indexing  terms  were  not  found  in  document  titles, 
but  were  synonyms  or  related  terms.  In  particular  the  literature 
of  chemical  compounds  and  biological  systems  included  a  high 
proportion  of  synonyms.  On  the  matter  of  synonyms  Lancaster  and 
Fayen  (49)  state  that  a  controlled  vocabulary  establishes  which 
of  several  synonyms  or  near  synonyms  will  be  used  as  preferred 
terras,  and  provides  references  to  this  term  from  the  possible 
variants. 

Haines  (25)  and  Lancaster  and  Fayen  (49)  define  three  other  tasks 
performed  by  a  thesaurus.  It  guides  users  to  preferred  terms 
by  means  of  an  entry  vocabulary  (lead  in  terms),  it  links 
together  termp  that  are  hierarchically  relatec,  and  links  related 
terms  by  cross  references;  and  finally,  a  tnesaurus  distinguishes 


homographs 


On  the  subject  of  lead  ir.  tertris  Rolling  asserts  their 

numbers  should  be  kept  as  low  as  possible,  as  it  seems  sense¬ 
less  to  overburden  a  tnesaurus  witn  unpermitted  terms. 

DRIT  (17)  provides  a  good  example  of  a  tnesaurus  wnicr.  does 
not  follow  this  rule.  As  stated  in  chapter  2  many  of  th<  .c-m'. 
ir.  terms  in  DRIT  are  simply  minor  variations  ir.  spelling  c: 
the  preferred  term.  Rolling's  point  is  tnat  only  those  terms 
wnicn  are  not  obvious  synonyms  should  be  used  on  lead  in 
terms,  sucn  as  this  example  from  TEST:  Cockroaches  USE 
Blattidae. 

Generally  a  thesaurus  is  generated  because  existing  tnesauri 
do  not  adequately  cover  the  field  required.  Tne  Low  Intensi tv 
Conflict  thesaurus  described  by  Deacon  and  Harvey  (13)  was 
developed  for  this  reason.  The  range  of  indexing  terms  in  TEST 
did  not  always  adequately  describe  tne  subject  material,  so  the 
new  thesaurus  was  based  on  the  relevant  descriptors  in  TEST, 
adding  terms  as  they  were  required.  NTIS  (S5)  prepared  tneir 
environmental  microthesaurus  to  bring  together  the  different 
index  term  sources  already  in  existence. 

TEST  (18)  began  life  as  Project  LEX,  a  thesaurus  developed 
by  a  committee.  Over  300  engineers,  scientists,  technical 
information  and  library  specialists  were  involved  in  the  work, 
totalling  over  1500  working  days  between  them  in  the  corr.pi lntion. 
The  ASTIA  Thesaurus  (2)  which  is  similar  ir.  composition  to  TEST 
was  compiled  by  the  Armed  Services  Technical  Intelligence 
Agency  in  collaboration  with  the  US  Department  of  Defense. 

In  this  context,  this  thesaurus  can  be  regarded  as  a  fore¬ 
runner  of  both  TEST  and  DRIT,  whicn,  as  noted  e>  Tier,  is  a  com¬ 
puter  compilation  (17). 


Keevil  (35)  describes  a  method  of  building  a  tnesaurus  in  wr.ic; 
candidate  indexing  and  lead  in  terms  are  selected  from  documents 
as  indexing  proceeds.  Tnis  procedure  is  tne  one  most  often 
used  for  maintenance  and  updating  of  thesauri.  Kim  (37)  main¬ 
tains  that  there  are  few  rules  and  conventions  for  updating 
thesauri,  and  for  this  reason  most  tnesauri  are  not  systemati¬ 
cally  updated,  if  they  are  updated  at  all.  As  Schirmer  (67) 
points  out,  a  tnesaurus  will  require  updating  as  end  when 
new  concepts  appear  in  the  technical  literature. 

3.7  Frecoordination  and  Postcoordinatior. 

Coordinate  indexing  is  the  process  of  combining  concepts  to 
define  a  subject.  It  is  useful  to  distinguish  between  pre- 
coordingation  and  postcoordingation  by  m^ans  of  the  definition 
provided  by  both  Lancaster  (48)  and  Foskett  (23). 

Precoordination  is  the  combination  of  separate  concepts  at 
the  time  of  indexing,  while  postcoordination  combines  separate 
concepts  at  the  time  of  retrieval. 

According  to  Foskett  (23)  precoordinate  indexing  terminologies 
include  most  of  the  major  classification  schemes  such  as  UDC, 
the  Dewey  Decimal  Classification,  Ranganatnon' s  Colon  Classifica¬ 
tion,  the  Bliss  Bibliographic  Classification  and  the  Library 
of  Congress  Classification. 

Willets  (76)  found  that  many  tnesauri  include  precoordination 
of  terms  in  their  structure,  producing  multiword  descriptors. 
Some  of  thesa  descriptors  are  heterogeneous  terms  but  the 
majority  are  entries  qualified  by  adjectives,  such  as  Hydraulic 


mining  ana  Subsurface  drainage.  Here  Wiilets  is  using  tne 
tern  precoordination  to  describe  preferred  terns  widen  consist 
of  two  or  more  words  or  a  phrase.  Generally  precoordinetion 
and  postcoordination  are  connected  witn  the  flexibility  of  a 
thesaurus  to  synthesise  concepts  by  tne  coordination  of  existing 
subjects.  The  more  a  tnesaurus  relies  on  fixed  precoordinat.ior. 
along  the  lines  of,  for  a  use  b  plus  c,  the  less  flexiole  it 
will  be. 

3.8  Specificity  and  Exhaustivitv 

Foskett  (2.3)  defines  specificity  as  tne  extent  to  which  an 
information  system  permits  the  user  to  be  precise  when  speci¬ 
fying  the  subject  content  of  a  document  and  exhaustivity  as  the 

extent  to  wnich  a  given  document  is  analysed  to  establish  what 

\ 

subject  content  is  to  be  specified. 

Higher  specificity  leads  to  higher  relevance,  but  at  the  expense 
of  recall,  whereas  an  increase  in  exhaustivity  increases  recall 
at  the  expense  of  relevance.  There  is  little  point  in  increas¬ 
ing  exhaustivity  unless  the  specificity  is  available,  i^  in 
depth  indexing  will  not  give  improved  access  to  the  contents  of 
a  document  unless  the  required  additional  indexing  terms  are 
specific. 

Vickery  (75)  points  out  that  it  is  important  to  match  the 
specificty  of  index  terms  to  the  kinds  of  query  tnat  tne  informa¬ 
tion  system  has  to  meet.  In  retrieval,  low  specificity  will 
lead  to  noise,  whereas  too  hign  a  specificity  may  miss  relevant 
items  unless  all  the  necessary  specific  terms  are  used. 


Aitcneson  and  Gilchrist  (1)  cor.firr.  that  specificity  controls 
the  precision  capabilities  of  an  information  system,  but  also 
demands  greater  skill  in  indexing  and  searching.  They  also 
point  out  that  the  disadvantage  of  a  highly  specific  vocabulary 
is  that  the  number  of  index  terms  required  for  the  system  is 
increased  and  it  is  consequently  more  expensive  to  compile, 
maintain  and  operate. 

3*9  Semantic  and  Syntactic  Aspects 

Jones  (33)  defines  three  requirements  of  thesaural  systems. 
These  requirements  are: 

1  a  basic  syntax  capable  of  differentiating  between 
various  word  functions; 

2  a  set  of  semantic  relationships  ^capable  of  intro¬ 
ducing  structure  by  eliminating  synonyms,  by  linking 
words  generally  and  by  differentiating  between  com¬ 
pound  forms; 

3  an  appreciation  of  the  structure  which  emerges  from, 
or  is  imposed  upon  a  topic  covered  by  a  thesaurus. 

These  requirements  should  be  compatible  with  the  microstructure 
of  the  system. 

Farradane  (21)  covers  similar  ground  when  he  writes  that  it  is 
necessary  to  overcome  various  types  of  ambiguity,  synonyms, 
homonyms,  jargon  and  even  illiteracy.  The  human  being  is  able 
to  overcome  errors  and  deduce  meaning  using  cues  of  context, 
emphasis,  gesture  and  knowledge,  but  even  taking  all  this  into 


account,  two  persons  may  derive  different  meanings  from  tne  same 
text.  Ke  also  points  out  (19)  tnat  relations  between  concepts 
often  appear  to  be  absent,  but  states  that  a  relation  between 
terms  is  implied  if  they  are  used  to  index  the  same  document. 
While  this  implied  relationship  will  be  absent  from  a  thesaurus, 
it  is  a  valid  related  term  concept  in  any  indexing  system. 

Braun  and  Schwind  (6)  argue  in  a  similar  vein  that  a  semanti¬ 
cally  oriented  index  offers  a  more  precise  system  than  otner 
methods,  and  will  help  exclude  bad  terms  from  the  terminology. 
Semantic  methods  can  be  used  to  obtain  phrases  intended  by  the 
text  which  is  to  be  indexed,  and  syntactic  methoc  •  must  be  used 
to  avoid  errors  and  resolve  ambiguities. 

Austin  (■“>)  in  his  history  of  the  development  of  PRECIS  describes 
the  semantic  aspects  of  the  system.  One  o^"  the  rules  states 
that  two  terms  should  not  be  written  as  adjacent  components 
of  a  string  if  the  first  serves  only  to  establish  the  class  of 
concepts  to  which  the  second  belongs.  For  example,  if  the 
string  contained  the  terms  Rodents  and  R£=ts  adjacent  to  each 
other,  then  the  first  term  would  be  excluded  on  the  grounds 
that  rats  are,  by  general  definition,  a  kind  of  rodent.  In 
this  way  the  most  specific  indexing  term  is  used  and  generic  terms 
and  near  synonyms  are  excluded. 

Lancaster  and  Fayen  (49)  discuss  the  automatic  syntactic 
analysis  methods  which  are  included  in  some  automatic  systems. 
These  systems  determine  structural  dependencies  between  words 
in  a  sentence  in  the  form  of  an  abstract  graph  or  tree  in 
which  each  word  forms  a  node  in  the  tree  and  the  syntactic 


dependencies  are  represented  by  brancnes.  Automatic  syn¬ 
tactic  analysis  of  this  type  will  yield  c  machine  2'eadable 
system  capable  of  producing  extremely  high  levels  of  searcr. 
precision,  because  it  allows  the  user  to  specify  the  exact 
relationships  existing  between  words  in  document  text  as  well 
as  the  words  occurring  in  request  statements.  Syntactic 
analysis  of  this  type  may  be  needed  for  fact  retrieval  or 
question  -  answer  systems,  ie  systems  that  attempt  to  provide 
a  direct  answer  to  a  question  rather  tnan  retrieving  a  piece 
of  relevant  text. 

Semantic  factoring  can  be  a  useful  device  for  handling  new 
concepts  if  this  does  not  produce  noise,  ie  the  factor  combi¬ 
nation  must  not  already  be  in  use  for  another  concept.  In 

this  instance,  Blagden  (4)  feels  that  it  is  worthwhile  ir.tro- 

% 

ducing  a  new  term. 

The  subject  of  compound  words  and  semantic  factoring  was 
studied  by  Jones  (34).  His  conclusions  are  that  difficulties 
are  caused  if  compound  words  are  factored  the  wrong  way,  and 
that  it  is  necessary  to  know  the  syntactic  origins  of  words  sc 
that  correct  semantic  factoring  can  be  made. 

Fracturing  all  compound  words  can  lead  to  noise  in  retrieval. 

One  suggestion  that  Jones  studied  is  to  use  a  single  word 
synonym  in  place  of  the  compound  where  one  exists.  Failing  t.i.is 
the  compound  term  should  be  used  where  the  parts  have  lost  sepa¬ 
rate  meaning  or  where  the  meaning  would  be  affected  if  the 


compound  is  fractured 


To  handle  words  which  have  more  than  one  semantic  meaning  and 
homographs,  Willetts  (?6)  suggests  that  scope  notes  or  paren¬ 
thetical  qualifiers  are  necessary  to  define  meaning.  For 
example,  the  term  Tanks  would  have  to  become  Tanks  (coraoat 
vehicles)  or  Tanks  (containers). 

According  to  Farradane  (20)  semantic  analysis  is  generally 
inadequate  and  is  patcnea  up  by  equally  napnazarc  devices  sucn 
as  links  and  roles  and  generic  posting,  which  often  only 
offers  a  selection  of  different  possibilities  of  higher  term. 
Generic  posting  is  a  useful  device  for  broadening  a  search, 
but  as  Blagden  (4)  points  out,  this  will  improve  recall  at 
the  expense  of  relevance. 

3.10  Links  and  Doles 

Links  and  Roles  are  devices  intended  to  overcome  false  coor¬ 
dinations  and  incorrect  term  relationships,  by  labelling 
groups  of  associated  terms,  or  indicating  the  roles  of  terms, 
and  are  a  controversial  issue.  Farradane* s  opinion  of  them  has 
already  been  seen  (20). 

Lancaster's  opinion  (47)  is  that  they  help  reduce  noise,  but 
more  specifically  he  feels  that  although  role  indicators  are 
intended  to  improve  the  specificity  of  an  index  language  and 
thus  the  precision  of  a  search,  they  cannot  improve  recall..  In 
fact,  because  they  define  classes  more  precisely,  role  indica¬ 
tors  will  actually  reduce  recall  (46). 


In  tests,  Van  Oot  et  al  (?4j  found  mat  links  and  roles 
produced  a  marxed  increase  -_r.  relevance,  but  roles  blocked 
relevant  retrieval  if  they  were  not  used  consistently  in 
indexing  and  searching.  Wnere  they  were  used  consistently, 
roles  reduced  false  drops.  On  this  subject,  Farradane  (20) 
feels  tnat  false  drops  and  other  noise  reflect  partly  a  lack 
of  word  control  and  partly  a  lack  of  semantic  control.  He 
also  maintains  that  tests  on  links  and  roies  give  conflicting 
results. 

In  other  tests,  Montague  (53)  found  that  links  and  roles 
improved  relevance  by  reducing  false  retrieval.  This  corres¬ 
ponds  with  Van  Oot's  findings.  Montague  also  found  tnat  syn¬ 
tactic  controls  made  a  high  level  of  relevance  achievable,  as 
did  deep  indexing,  vocabulary  control  and  provision  for  generic 
as  well  as  specific  searches.  Half  of  the  references  missed 
in  Montague's  tests  were  due  to  indexing  errors  and  insuf ficien'. 
depth  of  indexing. 

Taking  the  opposing  view,  Saracevic  (66)  avers  that  syntactic 
features  of  indexing  languages  such  as  links  and  roles  do  not 
reduce  the  overall  retrieval  of  non-relevant  answers,  except 
in  rare  instances.  Saracevic' s  opinion  is  that  more  relevant 
answers  can  be  achieved  by  making  broader  searches,  but  that 
this  will  introduce  much  more  non-relevant  material.  Jones  ( 
agrees  that  links  and  roles  have  been  judged  to  nave  doubtful 
value,  but  he  says  that  they  do  substantially  reduce  noise. 
Hutchins  (30)  believes  that  links  have  some  use  in  that  they 
can  indicate  how  terms  are  partitioned  between  two  topics. 
Mandersloot  e-t  al  (52)  maintain  that  homographs  dc  not 
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necessarily  need  roles  or  ocher  codes  to  clarify  meaning, 
as  the  combination  with  other  terms  will  usually  define  trie 
meaning  of  the  selected  homograph.  For  example,  the  combina¬ 
tion  of  Tanks,  Guns  and  Tracked  vehicles  is  sufficient  to 
indicate  that  tne  term  Tanks  refers  to  a  combat  venicie 
rather  than  a  water  container. 


3.1"  Readability 

No  references  to  work  on  this  subject  were  found  relating 
to  thesauri,  but  two  reports  by  Spencer  et  al  (65,  70)  present 
several  conclusions  which  are  of  interest. 

It  is  generally  agreed  that  a  text  comprising  a  mixture  of 
upper  and  lower  case  letters  is  much  easier  to  read  tnan  an 
all  upper  case  text.  This  is  borne  out  by  Spencer  et  al. 

In  tests  they  found  that  for  readability,  a  text  in  all  upper 
case  was  not  worth  considering. 

In  their  tests  on  spatial  and  typographic  coding  in  biblio¬ 
graphic  systems,  they  found  that  having  a  space  between  entries, 
together  with  making  the  first  element  of  an  entry  distinctive 
from  the  rest  of  the  text  provided  the  most  readable  and  effec¬ 
tive  system.  The  first  element  could  either  be  in  a  bolder 
type  or  physically  stand  out  from  t'ne  surrounding  text. 

3*12  Conclusions 

From  the  foregoing  it  is  possible  to  list  the  following  require¬ 
ments  of  a  thesaurus :- 
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1  The  thesaurus  must  provide  adequate  coverage  of  me 
subject  area  it  refers  to.  To  this  end  sufficient  pre¬ 
ferred  terms  are  needed  to  cover  all  concepts  connected 
with  the  subject,  together  with  a  lead  in  terminology 
which  will  direct  tne  user  to  tne  correct  preferred  term. 
For  a  small  thesaurus  this  causes  few  problems,  but  in 
the  case  of  tnesaurus  covering  a  wide  subject  area,  or 

a  multidisciplinary  thesaurus,  there  will  almost,  certainly 
be  conspicuous  gaps.  This  h*s  already  beer,  seen  in  tne 
Low  Intensity  Conflict  Thesaurus  developed  by  Deacon  and 
Harvey  03),  where  TEST  08)  did  not  adequately  cover  this 
field  but  part  of  TEST  was  used  as  the  basis  of  a  tnesauru. 
dealing  with  a  more  specific  subject  area. 

2  Generic  relations  between  terms  should  be  displayed 
in  a  hierarchy,  to  enable  generic  posting  and  search 
broadening  to  take  place.  Cross  references  to  related 
terms  should  be  shov/rw 

3  There  should  be  some  sort  of  terminology  control 
to  handle  synonyms,  antonyms,  homonyms  and  homographs, 
together  with  a  lead  in  vocabulary  to  guide  tne  user  to 
a  preferred  term.  In  this  context  it  is  useful  to  bear 
in  mind  Rolling’s  view  that  it  is  senseless  to  over¬ 
burden  a  thesaurus  with  unpermitted  terms  (37) 

4  Some  provision  should  be  made  for  syntnesis  in  order 
that  new  concepts  and  compound  words  can  be  handled  by 


the  thesaurus 


5  Ideally  tne  tnesaurus  should  r.ave  botn  iiterary  arc 
user  warrant.  Tne  tnesaurus  should  be  easy  to  read 
and  to  use  for  it  to  be  readily  accepted  by  users. 

Vickery's  criteria  (75)  can  be  used  as  guidelines  for  tne  start 
of  an  evaluation  of  tnesauri  (see  section  3*2).  From  this  list 
a  basic  scheme  can  be  derived: 

1  Compare  tne  basic  form  of  each  tnesaurus  and  the 
means  by  which  individual  terms  are  located  ir.  the 
thesauri.  The  number  of  terms  in  each  thesaurus  should  be 
compared  and  those  terms  common  to  each  be  determined.  Ir: 
the  present  work,  both  thesauri  are  alphabetically  struc¬ 
tured  and  only  a  terminology  comparison  is  reauired. 

2  Examine  the  semantic  and/or  syntactic  methods  by 
which  each  thesaurus  controls  vocabulary,  in  particular 
synonyms,  antonyms,  homonyms  and  homographs.  Also  tne 
use  of  compound  terms,  and  phrases  with  two  or  more  words, 
as  preferred  terms  should  be  studied  along  with  any  rules 
governing  the  admission  ot  tnese  terms. 

3  Evaluate  the  lead  in  vocabulary  of  each  thesaurus  ir. 
conjunction  with  synonym  control  etc.  The  number  of  suer, 
terras  is  important,  especially  if  variations  in  spelling 
are  used  as  alternative  lead  in  terms. 

4  The  hierarchical  structure  of  each  thesaurus,  if  suen 
a  thing  exists,  should  be  compared  and  tne  use  of  relations 
other  than  hierarchic,  between  terms  should  be  looked 


into 


4  Programme  of  Work 


1  Define  the  subject  area  to  be  studied.  In  work  on  multi¬ 
disciplinary  thesauri  such  as  TEST  and  DRIT  it  is  impractical 
to  cover  the  whole  subject  field.  Por  this  reason,  it  was 
decided  to  limit  the  study  to  a  subject  area  coming  broadly 
under  the  heading  "Military  Science". 

2  Compare  the  nierar.ehic  structure  of  eacn  thesaurus  and 

the  use  of  cross  references  to  related  terms.  Thi6  task  simpli¬ 
fies  to  a  study  of  the  hierarchy  because  while  TEST  has  broad 
term  (BT),  narrow  term  (NT)  and  related  term  (RT)  cross  referen¬ 
ces,  DRIT  only  uses  broad  and  narrow  terms. 

3  Compare  the  lead  in  terminologies  of  eacn  thesaurus. 

^  Compare  the  provisions  made  for  synthesis  in  each  thesaurus. 

In  some  instances,  this  will  coincide  with  item  3  because  where 
a  term  is  not  used  as  a  preferred  term,  some  guidance  to  a 
suitable  term,  or  combination  of  terms,  to  use  in  its  place 
is  necessary. 

5  Compare  the  specificity  of  each  thesaurus. 

6  Compare  the  indexing  terms  applied  to  reports  by  using  each 

thesaurus,  and  compare  each  set  to  terms  produced  by  the 
ASSASSIN  program. 

7  Obtain  users  reactions  to  each  thesaurus.  This  will  be 
subjective,  and  allowance  will  have  to  be  made  for  the  fact 
that  users  know  TEST  and  DRIT  will  be  new  to  them. 
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definition  of  Subject  Area  to  be  Studied 


5«1  Introduction 

As  noted  in  chapter  4,  it  was  decided  to  confine  the  subject 
area  to  the  field  of  Military  Sciences,  which  is  field  15 
of  the  COSATI  subject  category  list  (14).  The  actual  subject 
area  was  defined  by  constructing  a  broad  outline  model  of  the 
field  (see  Figure  1,  Appendix  l).  This  was  achieved  with  the 
aid  of  the  COSATI  subject  category  list  (14),  Janes  Weapons 
Systems  (6l)  and  personal  knowledge. 

5-2  The  model 

As  can  be  seen  from  Figure  1,  the  subject  area  as  defined  by 

COSATI  field  15  has  not  been  strictly  adhered  to,  and  parts  of 

\ 

other  COSATI  fields  have  been  interpolated.  In  particular, 
field  16,  Missile  Technology  has  been  incorporated  as  being 
related  to  Nuclear  Warfare. 

The  model  is  not  exhaustive  and  is  simply  a  personal  viewpoint 
to  define  subject  areas  of  interest.  The  relations  shown 
between  terms  in  the  model  are  not  based  on  the  structure  of 
either  thesaurus,  but  have  been  developed  as  the  model  grew. 
The  intention  here  was  to  avoid  any  bias  towards  TEST  or  DRIT 
in  constructing  the  model.  It  would  be  a  simple  matter  to 
prepare  a  much  larger,  more  detailed  model  incorporating  more 
concepts.  The  size  of  the  present  model  was  dictated  mostly 
by  the  limitations  of  space  available  on  one  page.  After 
taking  the  seven  main  subdivisions  of  COSATI  field  15-00,  the 
model  emulated  Topsy  and  "just  growed". 
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Most  of  the  subjects  included  car,  be  recognised  as  being  inclu 
ded  in  hierarchies  in  both  thesauri,  while  a  few  are  isolated 
terms. 

The  solid  lines  on  tne  model  connect  those  subjects  which  may 
be  expected  to  be  generically  related,  tne  arrows  indicate  tne 
direction  from  general  to  specific  ie  the  movement  down  a 
hierarcr.y.  Broken  lines  are  used  to  indicate  otner  relations 
whicn  may  be  expected  to  exist  between  terms.  For  example 
surface  to  underwater  missiles  may  be  considered  as  being  a 
related  term  to  torpedoes  (and  vice  versa),  although  the  two 
items  are  not  generically  linked. 

Having  defined  a  subject  area  it  was  decided  to  utilize  the 
hierarchies  from  both  thesauri  wtiich  included  the  following 
subjects,  for  further  study; 

Antipersonnel  agents 

Biological  v/arfare 

Bombing 

Camouflage 

Chemical  warfare 

Clothing 

De fence 

Flares 

Intelligence 

Logistics 

Military  facilities 
Military  operations 
Military  organisations 


Missiles 


Reconnaissance 


Security 

Strategy 

Surveillance 

Warfare 


These  nierarcnies  are  reproduced  in  Appendix  The  top  tern 
in  a  hierarchy  is  sho.Ti  furtnest  left,  while  hierarcnical  step 
are  indicated  by  successive  indentation.  Terms  at  the  right 
of  the  table  indicate  other  hierarchies  which  include  the  term 


opposite 


■*>  *r 


■.v.« . 


6  Comparison  of  TEST  and  DRIT 

6.1  Hierarchic  Relations 

This  section  was  confined  to  a  study  of  hierarchic  relations, 
ie  Broad  Term  (BT)  and  Narrow  Tern  (NT)  relations,  because 
DRIT  does  not  indicate  other  types  of  relationships.  TEST 
includes  cross  references  to  Related  Terms  (RT). 

The  first  point  of  interest  is  the  close  similarity  between 
the  two  hierarchic  schemes.  This  similarity  is  reflected 
in  the  rank  number  relations  derived  for  the  two  structures 
(see  section  6.3). 

The  most  obvious  difference  is  in  the  grouping  of  subjects  in 
the  hierarchies.  While  the  individual  hierarchies  in  TEST  tend 
to  be  short,  DRIT  groups  several  subjects  into  one  long  hier¬ 
archy.  As  a  result  of  this  TEST  seems  to  be  outnumbered  so 
additional  hierarchies  to  those  originally  chosen  were  selected 
from  TEST  to  correspond  with  the  additional  subjects  included 
in  the  Military  facilities,  Military  organisations  and  Warfare 
hierarchies  of  DRIT. 

Many  of  the  terms  in  DRIT's  hierarchic  structure  appear  in 
more  than  one  hierarchy,  to  such  an  extent  that  most  of  the 
terms  in  the  Chemical  warfare  hierarchy  also  appear  in  the 
hierarchy  for  Warfare.  Some  sets  of  terms  are  common  to  more 
than  one  hierarchy  in  both  thesauri,  especially  terms  from 
the  hierarchies  dealing  with  antipersonnel  agents  and  chemical 
warfare  agents. 
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Both  thesauri  utilize  tne  same  form  of  hierarchic  structure- 
ir.  that  in  going  from  terms  at  the  top  step  in  a  nierarchy  to 
lower  steps,  one  goes  from  the  general  to  the  particular. 

This  generic  structure  is  exhibited  well  in  both  tnesauri  ir. 
the  hierarchies  for  Antipersonnel  agents,  where  from  Anti¬ 
personnel  agents  the  first  step  takes  the  reader  to  Choking 
agents  and  Nerve  agents,  among  others.  One  step  below  Nerve 
agents  is  G  agents,  which  again  steps  down  to  particular  G 
agents,  such  as  GA  and  G5  agents.  Very  little  use  is  made 
of  part-whole  relations,  one  example  appears  in  DRIT  under 
Guided  missiles  in  the  step  to  Guided  missile  components. 

In  general  the  equivalent  hierarchies  from  eacn  tnesaurus  are 
similar  to  the  extent  that  equivalent  terms  from  the  next  step 
in  the  hierarchic  structure  of  both  thesauri.  There  are  a 
few  exceptions  to  this,  mostly  occurring  where  a  term  from  one 
thesaurus  does  not  have  an  equivalent  in  the  otner. 

As  is  to  be  expected  from  the  difference  in  the  number  of  pre¬ 
ferred  terms  in  each  thesaurus  (17,310  in  TEST  and  10,198  in 
DRIT)  there  are  more  terms  in  TEST  which  do  not  have  an  equiva 
lent  term  in  DRIT  than  vice  versa. 

DRIT  makes  much  use  of  precoordination  for  terms  which  are  not 
preferred  terms.  The  precoordination  is  printed  as  a  lead  in 
term,  and  the  user  is  referred  to  the  preferred  terms  whict. 
must  be  combined  to  represent  the  required  term.  For  example 
for  Guided  bomb  control  systems  DRIT  requires  the  three  terms 
Flight  control  systems,  Guided  bombs  and  Remote  control  to  be 


Many  of  DRIT' s  terms  combinations  are  used  for  more  t:inn  ore 
entry,  Fcr  example,  tn<?  combination  of  Cnemical  warfare,  and 
Military  forces  (foreign)  is  used  for  re  re i gn  cnemical  warfare 
Foreign  chemical  warfare  activities  and  Foreign  cnemical 
warfare  potential.  There  is  an  entry  also  for  Foreign  chemicn 
warfare  potentials,  but  here  the  combined  terms  are  Cnemica 
warfare  and  Foreign.  What  difference  exists  between  these 
latter  entries,  is  for  the  user  to  decide.  These  four  terms 
and  their  associated  USE  references  do  not  appear  in  TEST. 

This  use  of  precoordination  in  DRIT  would  undoubtedly  lead  to 
a  great  deal  of  noise  occurring  in  any  retrieval  system  based 
on  DRIT,  since  many  different  concepts  are  represented  by  the 
same  set  of  precoordinated  terms. 

Most  of  the  preferred  terms  in  DRIT  hove  an  equivalent  pre¬ 
ferred  term  in  TEST,  but  there  are  some  exceptions.  For 
example  Arsenic  agents  does  not  appear  in  TEST.  Conversely, 
there  are  terms  in  TEST  which  do  not  appear  as  preferred  terms 
in  DRIT.  The  TEST  term  Military  air  facilities  is  not  a 
preferred  term  in  DRIT,  the  nearest  entry  is  Military  air  base: 
and  the  user  is  instructed  to  use  the  term  Military  facilities 
instead,  which  is  not  such  a  specific  term. 

As  there  are  terms  in  DRIT  which  do  not  have  an  equivalent  in 
TEST,  so  there  are  similar  terms  in  TEST.  The  four  terms 
Amphibious  demonstrations,  Amphibious  raids,  Amphibious  with¬ 
drawals  and  Diversionary  landings  are  all  narrower  terms 
related  to  Amphibious  operations  in  TEST.  None  of  these  terms 
has  an  equivalent  in  DRIT,  the  user  has  to  rely  on  the 
term  Amphibious  operations  to  cover  the  requirements. 


6.2  Comparison  with  tne  Model 


It  is  interesting  to  compare  tne  structure  suggested  in  tne 
model  (Figure  i)  to  tne  actual  structures  used  in  each 
thesaurus.  As  an  example  consider  tne  structure  of  tnat  part 
of  the  model  centred  on  chemical  and  biological  warfare: 


Military  Science 

'  1 

Military  Operations 


\ 


Warfare 


X 


3iological 

Warfare 


Cnemical 

Warfare 


Y 


Biological 

Warfare 

agents 


Chemical 

Warfare 

agents 


\  / 

Antipersonnel  agents 


The  equivalent  section  of  TEST  is  confined  to  chemical  warfare 
(Military  chemical  operations)  as  the  terms  for  biological  war¬ 
fare  and  biological  warfare  agents  (Biological  operations  and 
Biological  agents)  are  not  included  in  TEST'S  hierarchical 
structure  but  are  isolates. 


Military  operations 
Military  chemical  operations 

The  TEST  terms  for  chemical  warfare  agents  and  antipersonnel 
agents  do  not  -appear  in  the  same  hierarchies  as  the  chemical 
warfare  term.  They  are  in  fact  separate  hierarchies,  each  with 


more  specific  terms  beneatn  tnem.  Some  of  these  more  specific- 
terms  appear  in  both  hierarchies. 


The  DRIT  structure  is  nearer  the  model. 


3iologicai 

Warfare 

\ 


Biological 

Warfare 

agents 


Warfare 

X 

N 

Cnerr.i  cal 
Warfare 

f 

Cnemical 
Warf  are 
agents 


Only  the  term  antipersonnel  agents  is  missing.  As  with  TEST, 
this  term  is  the  head  of  a  separate  hierarchy  and  some  of  its 
terms  also  appear  under  Chemical  warfare  agents  in  the  main 
hierarchy. 

% 

This  brief  study  has  served  to  highlight  difference  in  the 
structure  of  the  two  thesauri.  While  TEST  has  small  hierarchic 
classes  related  to  each  other,  DRIT  combines  the  equivalent 
small  classes  into  one  large  one. 

6.3  Specificity  of  Terms 

Hopker* s  metnod  was  used  to  compare  the  specificity  of  terms 
from  the  two  thesauri  (21).  Graphs  shoving  Rank  number  rela¬ 
tions  and  class-size-rank  relations  are  presented  in  Figures  ? 
and  3.  Tables  2  and  3  show  the  rank  number  derivation  for  the 
19  main  hierarchies  studied  from  each  thesaurus.  (See 
appendix  1 . ) 


As  has  already  beer,  stated,  some  of  the  DftIT  r.ierarcnies  tend 
to  be  much  longer  than  their  equivalents  in  TEST,  and  include 
topics  which  form  the  subject  of  separate  hierarcnies  in 
TEST.  For  example  many  of  the  terras  included  in  DRIT's 
hierarchy  for  Warfare  come  under  Countermeasures  in  TEST.  To 
ensure  a  fair  comparison  these  additional  subjects  have  been 
included  in  the  calculations  concerning  TEST'S  hierarchies. 

The  main  hierarchies  affected  by  tnis  are  tnose  covering  trie 
subjects  of  Military  facilities,  Military  operations,  Military 
organisations  and  Warfare. 

The  first  column  in  Tables  2  and  3  shows tne  totax  number  of 
terms  in  the  hierarchy,  taking  account  of  any  term  which  appears 
in  more  than  one  place  in  the  same  hierarchy.  The  second 
column  gives  the  number  of  terms  which  have  more  specific 
terms  below  them  (sub  terms)  in  the  hierarchy,  irrespective  of 
how  many  such  sub  terms  there  are.  This  differs  from  Hopker' s 
original  method  where  the  class  number  was  the  number  of  terms 
with  10  or  more  sub  terms  in  a  classification  scheme.  Because 
the  largest  hierarchy  studied  had  only  89  terms,  and  because 
generally  the  only  term  in  the  hierarchy  with  10  or  more  sub 
terms  is  the  main  term,  this  method  had  to  be  altered. 

Hopker' s  study  covered  class''  fication  schemes  in  wnich  class 
sizes  numbered  several  hundreds  of  terms  and  so  the  number 
10  was  convenient. 

The  third  column  in  Table  2  denotes  the  rank  of  each  hierarchy. 
The  rank  was  assigned  to  each  hierarchy  according  to  the  number 
in  column  two,  ie  the  hierarchy  with  the  highest  number  of  terms 
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with  more  specific  terms  was  ranked  numoer  1  and  so  on.  It 
is  interesting  to  note  tnat  only  two  equivalent  nierarchies 
from  each  system  had  tne  same  rank  number,  Warfare  and  Security 
while  most  of  the  others  have  a  rank  number  within  2  or  3, 
the  greatest  difference  between  each  thesaurus  being  five. 

The  class  for  Pyrotechnics  is  ranked  i4  in  TEST  and  9  in 
DRIT. 

Where  terms  have  tne  same  number  of  sutterms,  the  number  of 
terms  in  the  hierarchy  determine  the  ranking. 

Figure  2  shows  the  curves  of  rank  plotted  against  the  number 
of  terms  with  more  specific  terms  below  them  in  the  hierarchy 
for  each  class  from  the  two  thesauri.  The  curves  follow  eacn 
other  closely,  which  suggests  that  there  is  very  little  differ¬ 
ence  in  specificity  between  the  two  thesauri  in  the  subject 
area  studied.  " 

Figure  3  gives  curves  of  rank  plotted  against  the  number  of 
terms  in  each  class.  Again  the  two  curves  follow  each  other 
closely,  except  where  the  TEST  class  ranked  10  stands  out  from 
the  rest.  This  is  the  TEST  class  for  Missiles  and  combines 
two  small  hierarchies  while  DRIT  has  the  two  sections  in  one 
hierarchy.  The  DRIT  class  for  missiles  is  ranked  12,  ana  tnis 
■A  >es  rise  up  from  the  curve  but  it  is  not  so  prominent  as  TEST. 

The  TEST  class  for  missiles  contains  3?  terms,  “  of  which  have 
a  more  specific  term  below  them  in  the  hierarchy,  while  the 
DRIT  class  has  only  20  terms,  with  only  2  having  more  specific 


terms  below  tnerr. 


On  studying  the  hierarchies  again  it  is  possible  to  determine 
that  TEST  is  the  more  specific  of  tne  two  tnesauri.  Tnis  is 
borne  out  by  the  fact  that  several  of  the  more  specific  terms 
in  TEST  are  missing  from  DRIT.  The  narrower  terms  to  Amphibious 
operations  have  already  been  noted  (see  section  6.1).  Otuer 
terms  missing  from  DRIT  are  GE  agent,  GF  agent,  VG  agent  and 
VS  agent.  All  these  terns  appear  in  TEST  but  nave  no  eouivelent 
in  DRIT,  nor  is  there  a  USE  reference  relevant  to  these  terms. 

6.4  Lead  in  Terminologies 

As  is  shown  in  Table  1,  DRIT  has  a  grand  total  of  91*970  entries 
of  which  10,198  are  preferred  terms,  leaving  81,772  unwanted 
terms.  In  contrast,  TEST  has  25*364  entries  of  which  1?,8l0  are 
preferred  terms,  with  just  5,554  terms  with  USE  references. 

Also  TEST  has  a  permuted  index,  the  user  can  find  a  word 
required  for  a  subject  or  one  close  to  it,  and  be  directed  to 
a  permitted  term,  or  terms  including  this  word.  This  is  not 
an  infallible  method  of  locating  the  required  term  -  especially 
where  the  required  term  is  not  included  in  the  thesaurus,  but 
it  avoids  having  the  main  body  of  the  thesaurus  overburdened 
with  unwanted  terms. 

Of  the  5*554  undesirable  terms  listed  in  TEST,  the  common 
practise  is  to  refer  to  just  one  preferred  term  such  as  Tear 
gases  USE  Incapacitating  agents.  Some  precoordination  is 
practised,  usually  combining  two  terms  and  sometimes  three. 

Two  examples  of  this  are;  Cross  servicing  (military)  USE 
Logistics  services  and  Interdepartmental  procurement;  Hard 
point  defense,  USE  Terminal  defense  and  Hardened  installations. 


Three  term  combinations  are  comparitively  rare  in  TEST,  but  are 
common  ir.  DRIT.  Four,  five  and  even  six  term  combinations  are 
to  be  found  in  DRIT,  aitnough  admittedly  the  latter  two  cases 
are  rare.  DRIT  has  an  entry  AP-alurainiz.ec  binoer  -  AP  sandwicnes 
USE  Aluminum  and  Ammonium  perchlorate  and  Binders  and  Laminates 
and  Solid  rocket  fuels  and  Solid  rocket  oxidizers,  a  combina¬ 
tion  of  six  terms.  Tnis  particular  precoordinatior.  must  be 
quite  unusable  in  most  indexing  systems,  unless  a  computerized 
retrieval  system  is  used. 

Wnen  USE  references  are  included  in  a  tnesaurus  it  follows 
that  a  preferred  term  is  called  upon  to  act  for  more  than  one 
subject.  TEST  copes  fairly  well  in  this  respect,  since  a 
term  is  used  to  represent  up  to  only  five  or  six  subjects.  In 
DRIT  however,  with  it  far  higher  incidence  of  USE  references, 
a  term  can  be  called  upon  to  represent  as  many  as  400  concepts. 
The  DRIT  preferred  term  "Materials''  is  referred  to  by  more  than 
4j>C  entries.  Admittedly,  about  ?80  of  these  are  in  combination 
but  this  leaves  at  least  fifty  topics  represented  by  just  the 
one  word,  including  Material  parameters,  Material  performance, 
Material  problems,  Material  processes,  Material  properties, 
Material  requirements,  Materials  applications,  Materials 
components,  Materials  equipment,  Materials  processing  and 
Materials  science. 

This  must  inevitably  lead  to  a  lack  of  specificity  and  the 
introduction  of  noise  into  a  retrieval  system  using  DRIT.  The 
example  quoted  is  extreme  but  not  unique  (Models  is  another  pr** 
ferred  term,  referred  to  by  at  least  400  entries)  but  10  USE 
references  to  a  preferred  term  is  common  in  DRIT. 


Indexing 


7.1  Introduction 

An  indexing  comparison  between  the  two  thesauri  was  undertaken, 
using  the  titles  and  abstracts  of  25  reports  identified  as 
being  related  to  the  COSATI  150C  and  1600  subject  areas.  At 
the  same  time  the  abstracts  were  indexed  by  tne  ASSASSIN' 
program  in  order  that  index  terms  selected  from  the  titles  and 
abstracts  of  tne  reports  could  be  compared  with  the  terms  from 
each  thesaurus. 

DRIC's  indexing  staff  were  asked  to  assign  descriptors  to  each 
abstract,  using  each  thesaurus.  Each  abstract  was  indexed 
twice  from  each  thesaurus  by  two  persons,  and  the  two  sets 
of  descriptors  were  combined.  Each  indexer  was  asked  to 
arrange  the  descriptors  in  order  of  relevance,  so,  because  two 
indexers  would  probably  have  different  ideas  as  to  what  the 
most  important  descriptors  were,  the  final  combination  of 
descriptors  can  be  regarded  as  having  the  most  important 
descriptors  listed  first,  with  subsidiary  terms  in  the  second 
half  of  each  list. 

Also,  indexers  were  asked  to  assign  additional  descriptors  for 
concepts  not  covered  by  the  thesaurus  being  used  at  the  time, 
but  which  were  considered  to  be  relevant  to  the  abstract. 

These  additional  terms  are  indicated  by  an  asterisk  in 
appendix  4,  which  shows  the  descriptors  allocated  to  each 
reference  from  each  system. 

Appendix  4  also  details  the  free  text  terms  selected  from  the 
title  and  abstract  of  each  reference  by  the  ASSASSIN  package. 
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No  attempt  has  beer,  made  to  arrange  these  terms  in  order  of 
relevance,  they  are  presented  in  alphabetical  order  just  as 
ASSASSIN  produced  them. 

The  abstracts  sheets  given  to  DRIC's  Techncial  Information 
Staff  for  the  purposes  of  this  exercise  are  included  in 
appendix  3. 

* 

7-2  Users  Reactions  to  tne  Thesauri 

After  using  each  thesaurus,  eacn  indexer  was  asked  for  their 
comments  on  each,  using  the  simple  questionnaire  included  ir. 
appendix  3. 

When  considering  the  replies  from  tnis  questionnaire  attention 
was  paid  to  the  fact  tnat  each  indexer  was  used  to  TEST  and 
tnat  only  a  few  of  the  abstracts  were  indexed  by  each  person. 
However,  first  impressions  of  DRIT  are  useful,  ano  taking 
tne  bias  to  TEST  into  account,  some  useful  conclusions  are 
drawn. 

7.3  Indexing  from  TEST  and  DRIT 

For  the  twenty  five  references  studied,  tne  lists  of  indexing 
terms  assigned  from  each  thesaurus  are  similar.  Where  addition 
terms  were  added  to  e  list  of  index  terms,  tnese  terms  come 
into  three  categories.  The  bigrest  category  is  the  one  involv¬ 
ing  terms  which  were  added  to  botn  lists  for  wnich  no  equivokes 
could  be  found  in  either  thesaurus.  Ir.ese  terms  are:- 


Mukluks 


(Reference  1) 


OSIo 

Masterplan 
Dexteri ty 

Reefed  mains  extraction 
Long  term  effects 
World  vide  effects 
Somatic  effects 
GACAK-1  (Model) 
TAC-COKTENDER  (Model) 

The  second  largest  category, 
that  in  which  TERMS  added  to 
term  in  TEST. 

Boots 

Evaluation 

Design 

Trends 

Antiradar  missiles 
Color  matching 
Combat  uniforms 
F-region 


(Reference  5) 

(Reference  ;') 

(Reference  4) 

(Reference  1rj) 

(Reference  lb) 

(Reference  lb) 

(Reference  1o) 

(Reference  22) 

(Reference  22) 

almost  as  big  as  the  first,  is 
the  DRIT  list  had  an  equivalent 

(Reference  2) 

(Reference  2) 

(References  2,  17  and  2^) 
(Reference  4) 

(Reference  6) 

(Reference  10) 

(Reference  10) 

(Reference  14) 


The  smallest  category  is  that  consisting  of  terms  added  to  the 
TEST  list,  for  which  an  equivalent  exists  in  DRIT. 


Crises 

China 

Ground  crews 


(References  4  and  7) 
(Reference  4) 
(Reference  5) 
(Reference  10) 


Australia 


It  could  be  argued  that  tne  second  category  is  in  fact  tne 
same  size  as  the  first  because  the  term  Design  appears  in 
three  references,  giving  a  total  number  of  additional  indexing 
points  of  IQ,  the  same  as  for  tne  first  category  terms. 

However,  counting  the  number  of  additional  terms,  and  aes- 
regarding  the  number  of  times  a  term  was  used,  gives  8 
indexing  points  for  the  second  category. 

Considering  the  greater  number  of  preferred  term  entries  in 
TEST,  it  is  not  really  surprising  that  more  terms  were  added  to 
the  lists  from  DRIT  (l8)  than  to  those  from  TEST  (13). 

Of  the  terms  added  to  both  lists,  six  terms  can  be  considered 
as  being  very  specific,  Mukluks,  OSIS,  Reefed  mains  extraction, 
Somatic  effects,  GACAM-1  (Model)  and  TAC-CONTENDER  (Model), 
and  two  as  being  very  general,  Long  term  effects  and  World  wide 
effects.  Because  of  this,  it  is  difficult  to  justify  the  inclu¬ 
sion  of  any  of  them  in  any  revision  of  either  thesaurus.  For 
example  it  can  be  argued  that  Mukluks  can  be  adequately 
described  by  both  thesauri  by  the  term  Footwear,  and  OSIS  by 
the  combination  of  the  terms  Ocean  surveillance  and  Information 
systems.  On  the  other  hand,  the  terms  Long  term  effects  and 
World  wide  effects  are  too  general  to  be  admitted,  even  thougn 
both  thesauri  already  contain  terms  of  the  same  type. 

Turning  to  the  third  category,  ie  terms  which  appear  ir.  DRIT 
but  not  in  TEST,  one,  Crises,  does  not  appear  in  either 
thesaurus,  but  DRIT  does  have  the  corresponding  term  Emergencies 
These  terms  can  be  considered  analagous  and  either  would  be 
a  suitable  term  for  inclusion  in  a  revision  of  TEST,  as  would 


trie  term  j round  crews.  The  other  two  terms,  Chins  and  Austral! 
are  not  really  necessary  terms  for  a  tnesaurus.  DSIT  nar 
several  ocher  terms  for  geographic  location,  including  terms  fo 
all  the  states  of  the  USA I 

The  third  category,  tnose  terms  ir.  TEST  wr.ich  ere  not  in  DR  IT , 
is  composed  of  specific  terms,  witn  the  exception  of  Evaluation 
and  Design.  This  adds  weight  to  tne  conclusion  reached  earlier 
(see  section  6.2)  mat  TEST  is  the  more  specific  of  the  two 
thesauri . 

One  point  of  interest  which  arises  here  is  TEST’s  term  Boots 
(footwear).  It  is  difficult  to  see  tne  point  of  saving  tne 
qualifier  (footwear)  in  the  term  because  tne  context  of  tne 
report  would  distinguish  Boots  (footwear)  from  any  other  Boots, 
such  as  Boots  (Cnemist),  which  incidentally  is  the  only  poesicl. 
alternative  to  Boots  (footwear)  which  springs  to  mind. 

7.4  ASSASSIN 

The  index  terms  assigned  by  tne  ASSASSIN  package  are  also 
listed  in  appendix  4.  Unlike  the  other  two  lists,  these  terms 
are  given  in  alpnabetical  order,  rather  than  in  order  of 
relevance. 

The  ASSASSIN  program  has  produced  complete  factoring  of  ail 
terms,  except  where  these  have  been  deliberately  hypr.enated 
in  the  computer  input,  eg  Down-draught  and  Electronic- 


countermeasures 


The  ASSASSIN  terms  do  illustrate  the  value  of  a  thesaural 
type  indexing  system,  especially  in  the  case  of  reference 
24.  Here,  ASSASSIN  has  produced  17  terms  including  Air- 
launched,  Airframes,  Cruise,  Expendable,  Flight  and  Vehicles. 
The  thesaural  systems  include  the  terms  Airframes,  Missile 
airframes,  Cruise  missiles,  and  Drone  aircraft  (TEST)  and 
Airframes,  Guided  missiles,  Cruise  missiles,  and  Drones 
(DRIT).  This  is  an  illustration  of  the  indexers  use  of 
knowledge  that  an  expendable  air  launched  cruise  vehicle  is 
either  a  drone  aircraft,  or  (more  likely)  a  cruise  missile, 
and  so  the  appropriate  terms  have  been  added.  The  ASSASSIN 
program  makes  provision  for  additional  terms  of  this  type, 
but  a  completely  automated  indexing  system,  as  ASSASSIN  was 
used  here,  misses  these  points. 

7.5  Term  Relations  in  each  Thesaurus 

In  this  section  some  terms  from  the  ASSASSIN  list  have  been 
selected  and  the  term  relations  of  their  equivalents  in  TEST 
and  DRIT  have  been  studied.  In  particular  the  terms'  posi¬ 
tions  in  hierarchies  and  their  relations  to  other  terms  in  the 
respective  hierarchies  have  been  studied. 

The  terms  chosen  for  this  study  are: 

ASW  (an  abbreviation  for  antisubmarine  warfare) 

Air  to  Air  engagements 
Footwear 
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•'j 


n 


M 


n 


Mustard 


Additionally  the  following  terms,  in  coordinstior.,  were 
selected 


Chemical  Warfare 
Ocean  Surveillance 


ASSASSIN 

term 

ASW 

TEST 

term 

Antisubmarine 

warfare 

DRIT 

term 

Antisubmarine 

warfare 

A  solid  line  indicates  hierarchic  relation,  with  arrows 
showing  the  direction  from  general  to  specific,  while 
dotted  lines  indicate  cross  references,  or  related  terms. 


TEST 


Naval  mine 
warfare 


Acoustic 

surveillance' 


Warfare 

I  / 

•ANTISUBMARINE  WARFARE 


Undersea 

warfare 


Antisubmarine 

aircraft 


j  Harbor 
;  defense 


Antisubmarine 

minefields 


Submarine 

«  detection 

\ 

\ 

Hunter-killer 

groups 


DR  IT 


Warfare 

Undersea  warfare 

I 

ANTISUBMARINE 

WARFARE 

t 

Hunter-Killer  groups 


'•4 
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b;  ASSASSIN  term  Air  to  Air  engagements 


TEST  term  Aerial  warfare 

DRIT  term  Aerial  warfare 


TEST 


DR  IT 


Warfare 


AERIAL  WARFARE 


Warfare 

\ 

AERIAL  WARFARE 


c)  ASSASSIN  term  Footwear 

TEST  term  Footwear 

DRIT  term  Footwear 

TEST 


Clothing 

t 


Socks 


Artie  clothing .  .  FOOTWEAR  - . 

\  X 

Boots  \ 

(footwear)  *«  Shoes 


Combat 

uniforms 


Hosiery 


DRIT 


Clothing 

t 

FOOTWEAR 

I 

Shoes  Snowshoes 


Protective 

clothing 


ASSASSIN  tern  Mustard 
TEST  term  Mustard  agents 

DRIT  term  Mustard  Agents 


Antipersonnel 
agents 


Lewisite 


Military  chemical 
agents 


Vesicants 


MUSTARD  AGENTS 

t 

Nitrogen  mustards 


Warfare 


Chemical  agents 


Chemical  warfare 

X 

Antipersonnel  Chemical  warfare 

agents  agents 

Vesicants 

MUSTARD  AGENTS  Lewisite 

t 

Nitrogen  mustards 


Arsenic 

agents 


ASSASSIN  term  Chemical  warfare 

TEST  term  Military  chemical  operations 


DRIT 


term  Chemical  warfare 


Military  operations 

I 


CBR  operations 


Chemical  agent 
detection 


Military 

chemical 

agents 


MILITARY  CHEMICAL  -  .  . .  . 

• OPERATIONS  .  Protectl,e 


:  /  |  Protective 

:  ?  \  clothing 

*  « 

Chemical  \  Flame 

ammunition  ■  warfare 


Portable 

shelters 


Warfare 


CHEMICAL  WARFARE 

I 

T 

Chemical  warfare  agents 


ASSASSIN 

term 

Ocean 

surveillance 

TEST 

term 

Ocean 

surveillance 

DRIT 

term 

Ocean 

surveillance 

TEST 

Acoustic  surveillance 


Surveillance 


OCEAN  SURVEILLANCE 

Coastal  surveillance i  '•  "  Visual  surveillance 


I  \ 


'^IJndersea  surveillance 


Combat 

surveillance 


Space 

surveillance 
(space  borne) 


Radar  surveillance 


Space  surveillance 
systems 


Acoustic 

surveillance 


Combat  ' 
surveillance 


Surveillance 

/  ,  sr 


Undersea  surveil¬ 
lance 


OCEAN  SURVEILLANCE 


Visual 

surveillance 


These  few  terms  enable  a  closer  examination  of  selected  areas 
of  hierarchies,  as  well  as  an  examination  of  related  terms  in 
TEST. 


The  first  term  studied,  Antisubmarine  warfare,  shows  differences 
in  hierarchical  construction.  In  TEST  the  terms  Undersea  war¬ 
fare  and  Hunter-killer  groups  are  terms  related  to  Antisubmarine 
warfare,  whereas  DRIT  includes  them  both  in  the  hierarchy, 
Undersea  warfare  as  a  broad  term  and  Hunter-killer  groups  as  a 
narrow  term  to  Antisubmarine  warfare. 

In  TEST,  these  terms  appear  in  different  places  in  the  hierarchy 
Undersea  warfare  is  a  narrow  term  from  Warfare,  and  only  appears 
as  a  related  term  to  Antisubmarine  warfare.  Hunter-killer 
groups  is  again  a  related  term,  but  does  not  appear  in  a 
hierarchy.  It  is  in  fact  an  isolate. 

The  second  term,  Aerial  warfare,  is  treated  similarly  in  each 
thesaurus,  and  no  further  comment  is  necessary. 

Footwear  again  shows  some  differences.  The  basic  structures  of 
the  hierarchies  are  similar,  but  where  TEST  treats  Socks  as  a 
related  term,  DRIT  includes  it  in  the  hierarchy.  This  example 


also  includes  a  term  in  each  hierarchy  that,  does  not  appear 
in  the  other: 

Boots  (footware)  (TEST)  and  Snowshoes  (DRIT). 

The  next  two  terms,  Mustard  agents  and  Chemical  warfare,  are 
best  considered  together  because  DRIT  actually  combines  two 
hierarchies  in  one. 

The  TEST  and  DRIT  hierarchies  concerning  Mustard  agent6  are 
essentially  similar  (except  for  the  term  Arsenic  agents  which 
appears  in  DRIT)  up  to  the  two  broad  terms  Antipersonnel 
agents  and  Military  chemical  agents.  In  the  case  of  DRIT  the 
alternative  term  Chemical  warfare  agents  is  used  for  Military 
chemical  agents,  and  it  is  here  that  the  second  difference  is 
observed.  Chemical  warfare  agents  has  two  broader  terms, 
Chemical  agents  and  Chemical  warfare,  which'  in  turn  is  a 
narrower  term  to  Warfare. 

Chemical  warfare,  or  Military  chemical  operations  bb  TEST 
prefers  it,  is  in  TEST  a  narrower  term  to  Military  operations 
rather  than  Warfare,  and  Military  chemical  agents  is  a 
related  term  rather  than  a  narrower  term. 

As  can  be  seen  from  the  full  DRIT  hierarchy  included  in 
appendix  1,  the  hierarchy  including  Chemical  warfare  agents 
also  includes  terms  related  to  Chemistry  such  as  Chelating 
agents  and  Grignard  reagents. 

The  last  term,  Ocean  surveillance,  is  again  treated  similarly 
by  each  thesaurus. 


» 


;'\i 

4 


•V 
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User  Reaction 


8.1  Readability 

Samples  of  the  presentation  of  each  thesaurus  are  included  in 
Figures  4  and  5,  see  appendix  1.  DRIT' s  computer  origin  is 
obvious  in  its  presentation.  The  only  concessions  to  readability 
are  the  bold  print  of  the  entry,  the  indenting  of  subsequent 
lines  and  the  large  print  used.  No  differentiation  is  made 
between  preferred  terms  and  lead  in  terms,  which  makes  search¬ 
ing  for  one  term  in  90,000  entries  rather  difficult.  TEST  has 
a  similar  layout  to  DRIT  but  there  are  not  so  many  terms  to 
search  through  wich  simplifies  matters. 

TEST  is  printed  in  upper  and  lower  case,  and  differentiates 
between  preferred  terms  and  lead  in  terms  by  printing  the  latter 
in  italic.  This  does  make  TEST  the  easiest  of  the  two  thesauri 
to  read.  One  indexer  said  that  after  using  DRIT  for  more  than 
fifteen  minutes  his  eyes  refused  to  focus  on  the  all  upper 
case  print. 

One  minor  difference  between  the  two  thesauri  is  connected 
with  the  larger  print  used  in  DRIT.  Because  of  this,  DRIT's 
presentation  i6  a  three  column  layout,  as  opposed  to  the  four 
ooluran  layout  used  in  TEST.  The  inference  to  be  drawn  here 
is  that  DRIT  has  been  printed  in  a  large  typeface  in  an  attempt 
to  make  it  more  readable.  If  the  print  size  were  reduced  so 
that  a  four  column  layout  could  be  used,  and  so  reduce  the 
number  of  pages  necessary,  the  thesaurus  would  be  even  more 
unreadable  than  it  already  is. 


8.2  User  Preference 

Nine  people  took  part  in  the  indexing  exercise  and  were  asked 
for  their  opinions  of  the  two  thesauri.  Of  the  nine,  five 
preferred  TEST,  two  preferred  DRIT,  and  two  showed  no  preference 
One  of  the  latter  thought  the  sample  too  small  to  come  to  any 
conclusions,  but  felt  that  both  covered  some  topics  well  and 
were  poor  in  other  area$,  and  that  these  two  areas  did  not 
always  coincide.  This  same  person  went  on  to  say  that  he 
preferred  the  more  ordered  arrangement  of  TEST,  but  thought 
that  this  might  be  due  to  familiarity. 

The  other  indexer  who  showed  no  preference  for  either  thesaurus 
also  thought  that  familiarity  with  TEST  would  tend  to  weight 
any  opinion  of  preference.  He  further  thought  that  the  two 
thesauri  are  totally  different  concepts,  each  having  its  own 
advantages  and  disadvantages. 

Of  the  two  indexers  who  preferred  DRIT  one  liked  the  long  list 
of  USE  terms  which  enabled  a  precise  definition  of  descriptors. 
In  a  similar  vein,  the  other  indexer  liked  DRIT' s  use  of 
precoordination,  and  the  freedom  from  restriction  by  COSATI 
subject  fields  which  are  present  in  TEST.  At  the  same  time 
this  indexer  found  DRIT' s  format  too  difficult  to  read,  and 
locating  descriptors  was  too  much  like  hard  work. 

All  five  indexers  who  preferred  TEST  admitted  that  familiarity 
with  TEST  was  probably  a  contributory  factor  to  this  preference. 
A  greater  factor  was  a  dislike  of  DRIT.  The  most  voiced 
dislike  was  the  need  to  use  too  many  descriptors  to  describe  a 


concept.  Three  or  more  terms  to  define  e  concept  being  very 
common.  The  terms  in  DRIT  seem  to  cover  parts  of  concepts 
rather  than  the  whole,  which  again  leads  to  a  lot  of 
precoordination. 

One  abstractor  thought  that  DRIT' s  terms  tended  to  be  general 
rather  than  specific;  another  disliked  the  fact  that  DRIT  has 
a  word  by  word  alphabetic  arrangement,  rather  than  the  letter 
by  letter  arrangement  of  TEST.  This  means  that  words  in  DRIT 
appear  in  different  order  to  that  used  in  TEST. 

Two  indexers  disliked  the  existence  of  such  terms  as  Air  to 
surface,  and  Air  to  Surface  missiles  as  preferred  terms,  and  the 
existence  of  such  lead  in  terms  as  Surface-to-air  missile  and 
Surface  to  air  missile,  often  appearing  beside  each  other  in  the 
thesaurus. 

The  feature  which  was  most  liked  about  TEST  was  its  structure 
which  makes  locating  a  term  an  easier  task  than  it  is  with 


9  Discussion 

To  be  accepted,  a  multidisciplinary  thesaurus  must  compare  favourably 
with  TEST,  which  has  become  accepted  as  the  leader  in  this  field. 

DRIT  in  its  present  form,  does  not  meet  the  requirements. 

DRIT's  two  biggest  drawbacks  are  the  lower  number  of  preferred  terms 
(10,198  as  opposed  to  TEST'S  17,810)  and  the  overwhelming  number  of 
terms  with  USE  references,  which  have  a  suffocating  effect  on  the 
thesaurus. 

DRIT' s  preferred  terms  tend  to  be  more  general  than  the  terms  in 
TEST,  and  precoordination  is  used  for  many  concepts.  As  a  consequence 
of  the  general  nature  of  the  preferred  terms  the  precoordination 
becomes  unwieldy;  many  of  these  precoordinations  combine  three  or 
more  terms. 

Many  of  the  terms  having  a  USE  reference  are  unnecessary  since  they 
are  slight  variations  in  spelling,  and  are  often  adjacent  to  the 
term  they  are  referred  to.  If  these  terms  were  edited  out  of  the 
thesaurus  it  would  not  be  so  unwieldy  and  would  become  easier  to 

use. 

DRIT1 8  presentation  is  also  inferior  to  TEST'S.  It  is  all  upper 
case,  and  makes  no  concession  to  the  user  in  that  there  is  no 
differentiation  between  a  preferred  term  and  a  term  with  a  USE 
reference. 

Each  thesaurus  includes  terms  which  have  more  than  one  broader  term, 
but  this  practise  is  far  more  prevalent  in  DRIT.  When  generic  post¬ 
ing  is  used  to  broaden  a  search  this  would,  with  DRIT,  lead  to  the 
choice  of  broader  terms  envisaged  by  Farradane  (20)  and  to  a  possible 
introduction  of  noise  in  retrieval. 


TEST,  having  the  fewer  built-in  precoordinations,  would  offer  more 
scope  for  synthesis  than  DRIT.  Because  many  concepts  are  already 
represented  by  precoordination  in  DRIT,  precoordination  for  a  new 
concept  is  very  likely  to  introduce  noise  once  again  in  DRIT , 

With  TEST  such  noise  is  less  likely  to  occur.  Because  of  its  90,000 
plus  entries,  DRIT  is  more  likely  to  include  a  precoordination  for  a 
concept  than  TEST,  and  DRIT  is  often  used  in  DRIC  as  a  guide,  to 
see  how  a  concept  not  included  in  TEST  could  be  precoordinated. 

Should  a  second  edition  of  DRIT  be  envisaged,  the  following  points 
could  be  usefully  incorporated: 

1)  Increase  the  number  of  preferred  terms. 

2)  Rationalise  the  number  of  terms  with  USE  references. 

3)  Use  a  mixture  of  upper  and  lower  case  print  to  make  the 
thesaurus  easier  to  read. 

b)  Some  sort  of  typographic  coding  should  be  used  to 
differentiate  between  a  preferred  term  and  one  with  a  USE 
reference. 

With  so  much  in  DRIT  to  find  fault  with,  it  is  difficult  to  criti¬ 
cise  TEST,  which  has  become  an  unofficial  yardstick  against  which 
other  multidisciplinary  thesauri  are  judged.  Many  specialised 
thesauri  begain  life  by  taking  the  relevant  part  of  the  TEST  thesaurus 
and  carrying  on  from  there.  This  highlights  the  major  fault  with 
TEST  (which  is  also  a  fault  with  DRIT)  is  that  being  a  multidisa- 
plinary  thesaurus,  many  subjects  are  not  adequately  covered. 


TEST  preferred  terms  are  subjected  to  a  constraint  in  their  use  by 
the  COSATI  subject  field  which  is  allocated  to  each  term.  This 
is  a  difficulty  when  a  useful  term  is  found  and  the  COSATI  classifies' 
tion  indicates  that  the  term  is  relevant  to  a  field  other  than  the 
required  one.  However  this  difficulty  is  not  insurmountable,  the 
solution  is  to  use  the  COSATI  numbers  as  a  guide,  and  to  ignore  tnem 
altogether  when  such  an  occasion  arises  as  is  described  above. 

The  limited  indexing  exercise  conducted  for  this  investigation  has 
shown  that  some  compatibility  between  the  two  thesauri  exists,  but 
there  are  terms  in  each  thesaurus  which  have  no  equivalent  in  the 
other,  and  terms  which  have  no  exact  equivalent.  Some  examples  of 
the  latter  are  Military  chemical  operations,  Military  chemical  agents 
and  Missiles  from  TEST  which  become  Chemical  warfare,  Chemical 
warfare  agents  and  Guided  missiles  respectively  in  DRIT. 

From  the  larger  number  of  preferred  terms  available  in  TEST  and  the 
comparative  absence  of  fixed  precoordination  it  is  possible  to  deduce 
that  TEST  i6  the  more  specific  thesaurus,  and  that  it  has  a  more 
flexible  indexing  terminology  than  DRIT.  Also,  DRIT's  use  of  pre¬ 
coordination  means  that  the  same  terms  are  used  to  define  several 
different  subjects.  Thi6  would  introduce  a  great  deal  of  noise  at 
the  retrieval  stage.  This  also  allows  the  deduction  that  DRIT  would 
not  have  a  better  performance  them  TEST  in  retrieval  of  documents 
indexed  by  TEST. 

The  investigation  has  shown  a  method  of  assessing  the  value  of  a 
thesaurus,  without  the  necessity  of  a  reference  standard.  Ideally 
an  indexing  and  retrieval  exercise  should  be  conducted.  However,  an 
indexing  exercise  alone  will  give  some  useful  information.  A  much 


larger  number  of  documents  should  be  used  than  was  included  in  this 
work,  where  the  number  was  limited  by  time.  The  documents  chosen 
should  cover  all  fields  covered  by  the  tnesaurus,  not  just  one 
section  as  was  done  here.  An  indexing  exercise  on  this  scale  will 
not  only  highlight  those  areas  which  are  not  so  well  served  by  the 
thesaurus,  and  which  terms  are  missing  altogether,  but  will  enable 
an  objective  evaluation  to  be  made  of  the  specificity  of  the  terms 
included  in  the  thesaurus. 

It  can  be  argued  that  in  this  study  like  has  not  been  compared  with 
like  because  two  different  concepts  have  been  studied.  TEST  was 
derived  as  a  thesaurus  per  se,  while  DRIT  evolved  from  a  machine 
aided  indexing  background.  However,  DRIT  has  been  presented  as  a 
thesaurus,  and  so  can  be  compared  with  others.  Because  of  its  back¬ 
ground  of  machine  aided  indexing,  DRIT  would  be  a  useful  publication 
to  complement  any  automated  or  serai-automated  indexing  system. 
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Conclusions 


TEST  is  the  better  of  the  two  thesauri  for  the  following  reasons: 

1)  It  has  more  preferred  terms. 

2)  It  is  better  structured. 

3)  It  is  easier  to  read  and  use. 

4)  It  distinguishes  between  preferred  terms  and  terms  with 
USE  references  by  using  a  different  type  face. 

5)  TEST  is  more  likely  to  gain  user  acceptance  than  DRIT. 

TEST  has  a  more  specific  indexing  vocabulary  than  DRIT,  but  DRIT  has 
many  more  lead  in  terms  than  DRIT  and  so  can  be  said  to  give  better 
guidance  to  the  selection  of  preferred  indexing  terms.  Paradoxi¬ 
cally  this  is  one  of  the  faults  with  DRIT  in  its  present  form. 

There  are  far  too  many  unnecessary  lead  in  terms  in  DRIT  which  are 
simply  minor  variations  in  spelling,  such  as  singular  instead  of 
plural  and  hyphenated  versions  of  the  preferred  term  in  the  case  of 
a  compound  word  such  as  Surface  to  air  missiles. 

As  was  stated  in  chapter  1,  there  are  no  plans  known  concerning  a 
revision  of  TEST,  but  as  two  versions  of  DRIT  have  already  appeared, 
it  is  reasonable  to  conclude  that  DRIT  will  handle  new  concepts  more 
adequately  than  TEST.  This  will  only  hold  true  if  regular  revisions 
of  the  thesaurus  appear.  The  DRIC  system  of  adding  a  term  to  the 
indexing  language,  as  and  when  required,  is  the  only  alternative. 

If  TEST  were  replaced  by  DRIT,  two  major  problems  would  crise. 
Firstly,  for  the  reasons  already  stated,  there  would  be  a  high  level 
of  noise  included  with  material  retrieved  in  any  search  strategy 


based  on  DRIT.  Secondly,  a  lot  of  relevant  material  would  be  missed 
because  the  indexing  terms  from  the  two  tnesauri  cannot  be  considerec 
compatible.  This  answers  the  second  point  raised  ir.  the  terms  of 
reference  in  the  introduction:  TEST  will  undoubtedly  give  tne  better 
retrieval  results  on  DRIC's  holdings. 

There  would  be  no  advantage  gained  by  replacing  TEST  with  DRIT  in 
its  present  form.  This  would  actually  introduce  disadvantages. 

Should  a  new  edition  of  DRIT  be  made  available,  taking  into  account  t 
the  points  outlined  in  chapter  9,  this  situation  may  change. 

Since  it  arose  out  of  a  machine  aided  indexing  system,  DRIT  would 
be  a  useful  tool  in  this  area,  but  all  the  points  discussed  would 
still  have  to  be  borne  in  mind.  Some  editing  would  be  useful. 

As  has  been  stated  in  chapter  9i  ERIC  staff  often  refer  to  DRIT  for 
guidance  to  precoordination.  This  is  another  area  where  DRIT  would  be 
useful. 
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Recommendations  for  Further  Work 


In  its  present  fora,  there  is  nothing  to  recommend  any  further  study 
of  the  DDC  Retrieval  and  Indexing  Terminology.  Should  a  second 
edition  be  published,  this  may  warrant  further  study,  but  this  would 
have  to  incorporate  both  editing  of  the  massive  lead  in  terminology 
to  remove  the  unnecessary  terms  and  extending  the  number  of  preferred 
terms.  A  case  could  be  made  for  removing  some  of  the  present 
preferred  terms  which  are  themselves  only  part  of  another  preferred 
term. 

Any  future  work  on  a  second  edition  of  DRIT  should  first  check  for 
these  points  before  any  other  work  is  done. 

Evaluating  any  thesaurus  can  usefully  be  centred  on  an  intensive 
indexing  and  retrieval  exercise.  This  will  highlight  any  deficiencies 
in  the  thesaurus  and  enable  an  objective  measure  of  the  specificity 


of  terms  to  be  made 
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Proving  grouncs 
Rocket  tracks 
Shock  tubes 
Test  chambers 

Altitude  chambers 
Anechoic  cnambers 
Humidity  rooms 
Vacuum  chambers 
Test  stands 
Wind  tunnels 

Hypervelocity  wind  tunnels 
Subsonic  wind  tunnels 
Supersonic  wind  tunnels 


Tubes 


Transonic  wind  tunnels 


j-aooratorie 


Aeronautical  laboratories 
Biological  laboratories 
Chemical  laboratories 
Electroi'.ics  laboratories 
Hydraulic  xaooratories 
Mat nematics  laboratories 
Medical  laboratories 
Metallurgical  laboratories 
Nuclear  physics  laboratories 
Ordnance  laboratories 
Physics  laboratories 
Radiochemistry  laboratories 
Radiological  laboratories 


Other  Broad  Term 


Facilities 

Depots 

Supply  depots  Logistics 

Military  facilities 

Air  force  facilities 

Bare  bases 

Barracks 

Floating  bases 

Fortifications 

Naval  shore  facilities 

Naval  air  stations  Stations 

Naval  research  laboratories  Laboratories 

Submarine  bases 
Besearch  facilities 
Laboratories 

Aeronautical  laboratories 
Biological  laboratories 
Chemical  warfare  laboratories 
Electronics  laboratories 
Flying  laboratories 
Materials  laboratories 
Mathematics  laboratories 
Medical  laboratories 
Clinical  laboratories 
Metallurgical  laboratories 

Naval  research  laboratories  Naval  shore  facilities 
Ordnance  laboratories 
Physics  laboratories 
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( continued) 


Facilities  (continued) 


Nuclear  nnvsics  laboratories 


Radio chemistry  laboratories 


Radiolonical  laboratories 


Rocket  laboratories 


Terminal  flignt  facilities 
Airport  control  towers 
Airports 
Landing  fields 
Runways 
Taxi ways 
Landing  mats 


Test  facilities 


Altitude  chambers 


Light  gas  guns 


Gas  guns 


Model  basins 


Ranges  (facilities) 
Acoustic  ranges 
Guided  missile  ranges 


Range  safety 


Safety 


Tracks  (aerodynamics) 


Tracks 


Vacuum  chambers 


Chambers,  Vacuum  apparatus 


Wind  tunnels 


Hypersonic  wind  tunnels 


Subsonic  wind  tunnels 


Supersonic  wind  tunnels 
Transonic  wind  tunnels 


Underground  facilities 
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Military  operations 

Air  force  operations 
Aimooile  operations 
Area  denial 
Army  operations 
CBfi  operations 
Combined  operations 
Joint  operations 
Logistics  operations 
Military  cnemical  operations 
Naval  operations 

Amphibious  operations 

Amphibious  demonstrations 
Diversionary  landings 


>jt  nor  bread  i>  rrr.s 


Airborne  o Derations 


Amphibious  raids 
Amphibious  withdrawals 


Ctner  Broad  Terra 


.itarv  operations 

Kir  drop  operations  Aerial  aeiivery 

Air  force  operations 
airmobile  operations 
Ampnibious  operations 
beachheads 
Area  denial 
Army  operations 
Ir.terdiction 
Manoeuvers 

Fleet  manoeuvers 
Flight  manoeuvers 
Hovering 
Sideslip 
Turning  flight 
Military  exercises 
Military  formations 
Naval  operations 


organisations 


Corporations 
Expeditions 
Labor  unions 
Societies 

Tecimicai  societies 

Engineering  societies 
Scientific  societies 
Task  forces 


Trade  associations 


itarv  orgmsat  ions 
Air  force 

Armed  forces  (foreign) 

Armed  forces  (United  States) 
Marine  corps 
Armed  forces  reserves 
Army 

Coast  guard 

International  military  forces 
Multilateral  forces 
NATO  forces 
Navy 


Cti.er  nrc-ad 


DR  I  - 

Orgam  sstions 

Labor  unions  Industrial  relation 

Military  organisations 
’Calvary 

Military  forces  (foreign)  Foreign 

Military  forces  (United  States) 

Air  force 

Air  defence  command 
Air  force  logistics  command 
Air  force  systems  command 
Strategic  air  command 
Tactical  air  command 
Army 

Field  army 

Coast  guard  " 

Marin  e  corps 
Navy 

Military  reserves 
National  guard 
NATO 

Regiment  level  organisations 
Battalion  level  organisations 
Company  level  organisations 

Seabees  Naval  personnel 

Scientific  organisations 
Task  forces 

•This  is  surely  a  tnisprint  for  Cavalry 
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Missile  components 


Missile  antennas 
Missile  catteries 
Missile  destructors 
Missive  fuses 
Missile  warneaas 

Missiles 

Air  to  air  missiles 
Air  to  space  missiles 
Air  to  surface  missiles 
Air  to  underwater  missiles 
Antiaircraft  missiles 
Antimissile  missiles 
Antiradar  missiles 
Antisattelite  missiles 
Antiship  missiles 
Antisubmarine  missiles 
Antitank  missiles  Antitank  weapons 

Ballistic  missiles 

Fleet  ballistic  missiles 
Intercontinental  ballistic  missiles 
Intermediate  range  ballistic  missiles 
Medium  range  ballistic  missiles 
Short  range  ballistic  missiles 
Cruise  missiles 
Mobile  missiles 

.  (continued) 


v-’tr  er  .-.roar  *  rr r 

Anter.nas 

Fares  ordnance' 
rriearis 
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Missiles  (continued! 


Space  to  air  missiles 
Space  to  surface  missiles 
Surface  to  air  missiles 
Surface  to  space  missiles 
Surface  to  surface  missiles 
Surface  to  underwater  missiles 
Underwater  tc  air  missiles 
Underwater  to  surface  missiles 
Underwater  to  underwater  missiles 


uuiaec  missi  .e£ 


Air  tc  air  missiles 
/kir  to  r.uris :e  missiles 

Air  to  underwater  missiles 
Antiaircraft  missives 
antiradi ation  missiles 
Cruise  missiles 
Fleet  ballistic  missiles  • 
Guided  missile  components 
Guided  missile  antennas 
Guided  missile  batteries 
Guided  missile  computers 
Guided  missile  fu7.es 
Guided  missile  warheads 
Guided  missile  windows 
Nose  cones 

Reconnaissance  missiles 
Surface  to  air  missiles 
Surface  to  surface  missiles 


antiaircraft  missiles 


Antennas 

Electric  batteries 

Computers 

Fuzes  (ordnance) 

Warheads 

Noses 


Underwater  to  surface  missiles 


Pyrotechnics 

Flares 


'T’V'-'T 


Aircraft  flares 
Colored  flares 
Parachute  flares 
Rocket  flares 
Illuminating  ammunition 
Photoflash  ammunition 
Smoke  ammunition 
Spotting  charges 


M 


Pyrotechnics 

Flares 

aircraft  flares 
Colored  flares 
Float  flares 
Infrared  flares 
Parachute  flares 
Rocket  flares 
Illuminating  grenades 
Illuminating  projectiles 
Photoflash  ammunition 

Photoflash  bombs 
Photofla6h  cartridges 
Photoflash  projectiles 
Smoke  munitions 
Smoke  bombs 
Smoke  projectiles 


Oxnvr  dread  Terms 


Infrared  equipment 


urenades 

Projectiles 

Ammunition,  Photographi 
lignting  systems 

Bombs 

Cartridges 

Projectiles 

Ammunition 

Bombs 

Projectiles 
Explosive  charges 


Spotting  charges 
White  phosphorus 


Phosphorus 


Reconnaissance 


Acoustic  reconnissance 
Aerial  reconnaissance 
Electronic  reconnaissance 
Radar  reconnaissance 
Television  reconnaissance 
Ground  reconnaissance 
Infrared  reconnaissance 
Naval  reconnaissance 

Submarine  reconnaissance 
Photographic  reconnaissance 
Space  reconnaissance 
Ultraviolet  reconnaissance 


Visual  reconnaissance 


Surveillance 


Acoustic  surveillance 
Air  surveillance 
Coastal  surveillance 
Combat  surveillance 
Infrared  surveillance 
Ocean  surveillance 

Undersea  surveillance 
Radar  surveillance 
Space  surveillance  (ground  based) 
Ultraviolet  surveillance 
Visual  surveillance 


Warfare 

Aerial  mine  warfare 
Aerial  warfare 
Antisuomarine  warfare 
Cold  war 
Economic  warfare 
Electronic  warfare 
Flame  warfare 
General  war 
Jungle  warfare 
Landmine  warfare 
Limited  war 
Naval  mine  warfare 
Night  warfare 
Nuclear  warfare 
Political  warfare 
Psychological  warfare 
Space  warfare 
Special  warfare 

Counterguerilla  warfare 
Counterinsurgency 
Unconventional  warfare 
Evasion 

Guerilla  warfare 
Subversion 

Resistance  movement  (political) 
Tactical  warfare 
Undersea  warfare 


Urban  warfare 


0:  :i-r  broad  lernr 


countermeasures 


Acoustic  deco"? 


countercountermeasures 


Antijamming 


Electronic  counter- 
measurer 


Burr, through  ( countermeasures) 
Eocar  anti jamming 


Constant  false  alarm  receivers 


Radio  antijamming 


Electronic  countermeasures 


Antijamming 

Burnthrough  (countermeasures) 
Radar  antijamming 


Constant  false  alarm  receivers 


Radio  antijamming 
Electronic  jammers 

Electronic  noise  jammers 
Barrage  jammers 
Spot  jammers 
Sweepthrough  jammers 
False  target  generators 

Multiple  target  generators 


Radar  track  breakers 


Repeater  jammers 
Radar  confusion  reflectors 


Chaff 


Radar  deceiption 
Radar  camouflage 

Antiradar  coatings 


Count  ercour.te  measures 


( continued) 


Countermeasures  ^  continued. 


Radar  decoys 

Radar  jamming  Jamming 

Radio  deception 

Radio  jamming  Jamminr 

Jamming 

Infrared  jamming 
Radar  jamming 
Radio  jamming 
Mine  countermeasures 
Missile  countermeasures 
Optical  countermeasures 

Infrared  countermeasures 
Infrared  decoys 
Infrared  jamming 
Sonar  countermeasures 
Antieonar  coatings 
Noise  masking 

Acoustic  screening 
Sonar  interception 
Torpedo  countermeasures 
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Warfare 

Acoustic  warfare 

Aerial  warfare 

Battles 

Biological  warfare 

Biological  warfare  agents 
B  agents 
C  agents 

Chemical  warfare 

Chemical  warfare  agents 
B  agents 
Blood  agents 
C  agents 
Nerve  agents 
G  agents 
GA  agent 
GB  agent 
GD  agent 
V  agents 
VE  agent 
VX  agent 
Nonlethal  agents 
Choking  agents 
Incapacitating  agents 
BZ  agents 
CS  agents 
Irritating  agents 
CS  agents 


Other  broad  Terms 


Biological  agents 
Cnemical  warfare  agents 
Cnemical  warfare  agents 

Cnemical  agents 
Biological  warfare  agents 

Biological  warfare  agents 
Antipersonnel  agents 


Antipersonnel  agents 
Antiper  ;  el  agents 

Irritating  agents 

Incapacitating  agents 
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( continued) 


Warfare  (continued) 


Tear  gas 
Vomiting  agents 
Poisonous  gases 
Psycnochemical  agents 
Vesicants 

Arsenic  agents 
Lewisite 


uases 


Antipersonnel  agents 


Mustard  agents 

Nitrogen  mustards 

Cold  war 
Economic  warfare 
Electronic  warfare 

Electronic  countercountermeasures 
Antijamming 

Radar  antijamming 
Radio  antijamming 
Electronic  countermeasures 
Jamming 

Radar  jamming 
Radio  jamming 
Repeater  jammers 
Radar  deception 
Chaff 

Radar  camouflage 

Antiradar  coatings 
Radar  confusion  reflectors 
Radar  decoys 
Radar  repeaters 


Countermeasures 


Deception 

Radar  reflectors 

Camouflage 

Antireflection  coatings 
Radar  reflectors 
Decoys 

Radar  equipment, 
Repeaters 


Radio  deception 


Deception 

(continued) 


Warfare  (continued) 

Radar  interception 
Radio  interception 
Limited  war 
Mine  warfare 

Aerial  mine  warfare 
Land  mine  warfare 
Naval  mine  warfare 
Night  warfare 
Nontactical  warfare 
Nuclear  warfare 
Optical  warfare 
Psychological  warfare 

Radiological  warfare 

Radiological  warfare  agents 
Riverine  warfare 
Space  warfare 
Strategic  warfare 
Strike  warfare 
Air  strikes 
Tactical  warfare 
Flame  warfare 
Unconventional  warfare 
Counterinsurgency 
Geurilla  warfare 
Sabotage 
Subversion 
Terrorism 
.Undersea  warfare 

Antisubmarine  warfare 


Interception 

Interception 


Optics 

Military  psycnology. 
Psychological  operations 


Hunter  killer  groups 


1  Use  of  Impermeable  Mukluks  in  the  cold.  An  Initial 
Investigation 

R  W  Nolan 

6.1976 

Defence  Researcn  Establishment,  Ottawa,  Canada 
UNPUBLISHED  REPORT 

Abstract: 

A  series  of  laboratory  and  field  trials  was  conducted  to  compare 
standard  permeable  Canadian  Forces  mukluks  and  experimental 
impermeable  mukluks  with  respect  to  comfort,  moisture  accumulation 
due  to  foot  perspiration  an$  techniques  for  use.  It  was  found  that 
if  properly  dried  overnight,  there  was  little  difference  between  the 
two  types  of  mukluk.  However,  it  was  shown  that  conditions  inside 
a  tent  in  the  field  in  winter  are  such  that  drying  is  very  difficult 
and  moisture  accumulation  over  an  extended  period  of  time  may 
cause  significant  problems  with  either  type  of  footwear.  No 
subjective  differences  between  permeable  and  impermeable  mukluks 
were  observed. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  or  equal 
relevance? 


2  Experimental  Trial  of  a  Temperate  Lone  Winter  flying  boot. 
Aircrew  Equipment  Research  and  Development  Committee  Trial 

B  C  Short,  R  Needham 

6.197c 

Royal  Aircraft  Establishment,  Farnboroupr. ,  Harts  UK 
UNPUBLISHED  REPORT 

Abstract: 

An  experimental  trial  of  a  new  design  of  temperate  zone  winter 
flying  boot  was  carried  out  by  RAF  and  RN  personnel  engaged  in 
various  types  of  flying  and  survival  training  duties.  A  total  of 
4£  subjects  participated.  The  protocol,  experience  and  conclusions 
of  the  trial  are  given  together  with  recommendations  for  further 
development.  The  results  showed  that  60  perccent  of  aircrew  had 
no  criticism  of  the  current  '65  pattern  boot,  64  per  cent  of 
subjects  would  not  choose  the  trial  boot.  Most  complaints  regard¬ 
ing  the  trial  boot  were  related  to  its  low  height.  It  is  recom¬ 
mended  that  the  trial  boot  should  not  be  introduced  into  service 
in  its  present  form. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


3  final  Technical  Report  on  Ocean.  Surveillance  Information 

System  Masterplan 

5.1976 

CTEC  Inc,  Falls  Churcn,  Va,  US* 

UNPUBLISHED  REPOET 

Abstract: 

Flanning  studies  and  systems  engineering  related  to  t:ie  develop¬ 
ment  of  new  command  and  control  systems  for  tne  Navy  are  outlined 
A  variety  of  analyses  and  preliminary  planning  documentation  was 
developed,  which  was  related  first  to  tne  development  of  ar.  OSIS 
(Ocean  Surveillance  Information  System)  masterplan  and  subsequent 
to  the  development  of  TFCC  (Tactical  Flag  Command  CentreJ,  whici. 
will  be  specifically  designed  to  function  as  a  shipboaro  command 
control  system  operating  in  a  real-  or  near- real-time  environment 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


h  ^risi.5  Warr*ifi^  ar*c.  fvina^^rsenr 

Li  Bonrow 

5.1976 

Maryland  Univeristy,  Coll  Park,  USA 
UNPUBLISHED  REPORT 

Abstract : 

The  project  is  a  long-term  investigation  in  the  design  and  eveiuati 
of  tecnniques  for  monitoring  and  analysing  tae  crisis  benaviour  of 
nations  and  the  efficient  organisations  of  crisis  action  groups  ir. 
the  US  department  of  Defense.  Work  to  date  has  been  mainly  devoted 
to  a  study  of  Chinese  documents  to  identify  Chinese  methods  of 
crisis  diagnosis  and  tneir  benaviour  in  crisis  situations.  A  com¬ 
parison  is  being  made  of  Chinese  and  Western  perception  of  conflict 
situations  based  on  tne  CREON  data  base.  The  literature  is  being 
surveyed  to  find  possible  new  experimental  procedures  for  research 
into  crisis  decision  making. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant  or  of  equal 
relevance? 


5  Study  using  Infrared  Tnermograpuy  of  Cintning  Assemblies 

for  use  by  Personnel  Working  beneatr.  Operating  Helicopters 

R  P  Clark,  3  J  Muilan 

5.1976 

Royal  Naval  Personnel  Research  borrrr.i  1  tee ,  UK 
UNPUBLISHED  SEP0H1 

Abstract: 

Clotning  assemblies  have  Deen  evaluated  for  flignt  deck  personnel 
concerned  with  helicopter  operations.  Three  assemblies  were  worn 
by  subjects  and  exposed  to  tne  down-draught  of  a  hovering  Heli¬ 
copter  for  half-hour  periods.  Measurements  were  taken  using 
infrared  thermography  which  indicated  the  assembly  having  tne 
lowest  surface  temperature,  indicating  its  suitability  to  retain 
body  heat.  The  measurements  have  also  revealed  the  areas  of  the 
body  from  which  greatest  heat  loss  occurs  under  these  conditions. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 
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Study  Based  or;  tr.e  Problems  of  Electronic  wet: are  in  a 
Typical  Situation  of  an  Aerial  Attack  on  a  Target  at  Sea 

T  Linell 

3.1976 

Research  Institute  for  National  Defence,  otock;tOj.m,  Sweaen 
UNFU3LISHED  REPORT 

Abstract : 

Potential  interference  problems  arising  from  self-induced 
disturbances  in  a  defined  assault  situation  using  aerial  attack 
(by  side  A),  are  studied.  Tne  consequences  of  sucn  conflicts  are 
analysed  from  basic  principles  with  quantitative  examples.  The 
analysis  considers  both  an  attack  system  with  it  telecommunications 
and  weapons  (target  seeking  radar  missiles)  and  also  the  tele¬ 
communication  system  used  by  the  party  under  attack  (side  B), 
assumed  to  be  conducting  an  overseas  operation;  the  defence  consis 
ting  of  frigates  armed  with  surface  to  air  missiles  and  ECK 
equipment  for  disturbing  the  electronic  systems  in  the  aircraft 
and  their  armament. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant  or  of  equal 
relevance? 


7  Planning  for  Problems  in  Crisis  Management 

3.1976 

Consolidated  Analysis  Centres  Inc,  Wanningtor.  DC,  USa 
UNPUBLISHED  RETORT 

Abstract : 

Most  of  the  work  was  concentrated  on  Task  3  (identification  of 
clusters  of  crisis  management  problems),  information  coded  for 
eacn  of  300  crisis  and  103  terrorist  attacks  were  cross- tabulated 
and  typologies  constructed.  A  table  is  presented  in  which  numbers 
of  crises  and  terrorist  attacks  are  listed  against  a  number  of 
identified  variables,  including  pre-crisis  activity,  duration  of 
crisis  activity,  crisis  resolution,  outcome,  and  geograpnicai 
location. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant  or  of  equal 
relevance? 


6  dexterity  Afforded  by  Experimental  CW  Protective  Gloves 
P  V  Vittorio,  R  W  Ncian 
Z.1976 

Defence  Researcn  Establishment,  Ottawa,  Canada 
UNPUBLISHED  REPORT 

Aos  tract : 

Tne  effects  of  modified  Cnemical  Warfare  (.CW)  protective  gloves 
( ~  57- 9'17 )  on  manual  performance  and  ability  to  witnstand  high 
torque  values  wilhout  destruction  are  described.  The  manual 
performance  of  the  CV  gloves  was  compared  to  General-Piirpose  (CP) 
gloves  and  bare  hands  using  five  different  manual  tasks.  The 
results  show  tnat  performance  was  significantly  better  with  tne 
bare  hand  for  all  tests  except  the  torque  test  wnore  the  CW 
gloves  permitted  the  highest  torque  values  with  no  visible  signs 
of  damage.  The  four  remaining  tests  showed  that  the  GF  glove  and 
CW  glove  were  not  significantly  different  except  for  the  Minnesota 
Two-Kand  Turning  Test  where  manual  performance  was  slightly  better 
with  the  GP  glove. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant  or  of  equal 
relevance? 
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9  Safety  Manual  Mustard  Hydrolysis  Project 
C  H  Diehl 
2.1976 

Defence  Research  Establishment,  Suf field,  Ralston,  Alberta 
Canada 

UNPUBLISHED  REPORT 

Abstract : 

Sets  down  procedures  for  conducting  the  hydrolysis  of  mustard  at 
DRES.  The  paper  also  details  the  treatment  to  be  given  to  personne 
exposed  to  mustard  gas,  and  the  procedures  for  decontaminating  work 
ing  areas. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant  or  of  equal 
relevance? 


10 


Colour  Determination  of  Australian  Foliage  from  Reversal 
Film 

S  E  Jenkins 

IF. 197= 

Materials  Research  Labs,  Maribyrnong,  Victoria,  Australia 
UNPUBLISHED  REPORT 

Abstract : 

Pnotographs  were  taken  of  Australian  vegetation  with  Ektachrome  II 
and  'False  Colour'  Ektachrome  reversal  films,  and  colorimetric 
measurements  obtained.  The  examples  of  camouflage  netting  in  tne 
photographs  have  an  adequate  colour  match  to  the  general  vegetation 
but  lacked  sufficient  internal  contrast,  both  for  tne  natural  and 
false  colour  films,  to  be  efficient  camouflage.  The  results  of 
the  colour  measurements  of  vegetation  are  compared  with  the  colours 
recommended  to  the  Australian  Army  for  camouflage  netting  and 
uniforms  and  these  are  shown  to  be  an  exellent  match. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant  or  of  equal 
relevance? 


11 


Airportability  and  Airdrop  of  Equipment  for  Explosives 
Ordnance  Disposal  Teams 

12.1973 

Joint  Air  Transport  Establishment ,  RAE  Brire  Norton,  Oxford 
UK 

UNPUBLISHED  REPORT 

Abstract: 

Advises  on  the  internal  carriage  and  airdrop  of  equipment  required 
explosive  ordnance  disposal  teams.  Much  of  the  equipment  reauirea 
bv  such  teams  is  subject  ot  stringent  dangerous  air  cargo  regula¬ 
tions.  It  is  difficult  to  comply  with  these  regulations  and  to 
airdrop  the  equipment  satisfactorily.  It  is  recommended  tnat  tue 
equipment  either  be  packed  into  a  container  strap  personal  equip¬ 
ment  parachutist  and  dropped  with  the  individual  or  if  it  is  too 
large  for  this,  it  should  be  airdropped  in  a  Gemini. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


nesearcr.  upper turn  ties  ir. 
Acquisition 

2  V  Blanning,  o  Lana 


*f-fiDor.: 


it 


:r.e  nu:.ucsz.r r.t 


t  y  ? :  err.  .■ 


11.1975 

Pennsylvania  University,  Whartor.  Scnool,  Decision  Science 
Lept,  USA 

UNPUBLISHED  REPORT 

Abstract : 

Tne  object  of  tne  investigation  was  to  identify  major  areas  ir.  tne 
field  of  weapons  systems  acquisition  in  wnicn  researcn  might  be  done 
and,  within  each  area,  to  specify  researcn  projects  whicn  could 
usefully  be  undertaken  for  the  benefit  of  the  US  Navy.  Tne  five 
research  areas  identified  were:  contractual  coordination, 
incentives,  design  cnanges,  project  management,  and  external 
interactions.  The  individual  research  projects  are  described,  anc 
an  annotated  bibliography  is  included. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


1?  Airdrop  and  Airportabilitv  Clearance  :or  Laser  Target 

Marker,  Laser  Range  Finder  and  Night  Observation  Device, 
Category  A. 

D  A  Trotman 

10.197? 

Uoint  Air  Transport  Establismnent,  RaF  Abingaon,  berxs,  UK 
UNPUBLISHED  REPORT 

Abstract : 

Presents  the  results  of  trials  neld  to  clear  tne  Laser  Target 
Marker  and  Laser  Range  Finder  for  airdrop,  to  review  any  restric¬ 
tions  on  the  airportability  of  the  equipment  by  nelicopters  or 
fixed  wing  aircraft,  and  alsq-  to  determine  whether  tne  Night 
Observation  Device  Category  A  could  be  airdropped.  All  tne  equip 
ment  is  capable  of  being  airdropped  but  careful  attention  must  be 
paid  to  the  preparation  and  packing.  Although  the  Laser  Target 
Marker  and  Laser  Range  Finder  have  been  cleared  spearately  for 
airdrop  as  a  parachutists  load,  this  metnod  should  only  be  used 
when  the  tactical  situation  demands  it.  The  best  method  for  drop 
ping  tne  equipment,  is  on  a  Medium  Stressed  Platform  (MSP).  The 
Laser  Target  Marker  and  Laser  Range  Finder  have  beer,  cleared,  as 
general  cargo,  for  airportability  in  both  helicopters  and  fixed 
wing  transport  aircraft,  subject  to  the  provisions  of  this  report 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  ere  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


14  Optical  and  Infrared  Radiation  from  Nuej^tr  oursts 


E  Hyman 
9.197? 

Science  Applications  Inc,  L>a  Jolla,  California,  USA 
UNPUBLISHED  REPORT 


Abstract : 

Trie  major  effort  during  the  reporting  period  was  aimed  at  tne 
development  and  improvement  of  computer  programs  which  describe 
the  phenomenology  of  high  altitude  nuclear  bursts  and  the  resulting 
distrubed  atmosphere.  The  major  content  of  the  report  is  contained 
in  appendices  (A)  Transport  Techniques  for  Describing  Scattering 
and  Energy  Deposition  of  Energetic  Auroral  Electrons,  (B,  angular 
Properties  of  Particle  Fluxes  for  Strongly  Forward  Peaked 
Scattering,  (C)  Auroral  Nitric  Oxide,  (D)  Coupled  Barium  Cloud 
Ionosphere  systems,  (E)  Altitude  Dependent  Neutral  Wind  Effects  on 
Nonlinear  Motion  of  a  Barium  Cloud,  (F)  Theoretical  and  Numerical 
Simulation  Studies  of  Midlatitude  F  region  irregularities. 

Descriptors:  Selected  from  TEST/DR1T  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


15  Airdrop  Clearance  by  Reefed  Mains  Extraction  (RME)  on  tne 
Medium  Stressed  Platforms  (MSP)  Kk  3  Part  A  Tool  Kit  QP, 
Engineer,  400  Hz  (CES  40734)  and  Part  a,  Water  Purification 
Unit  Complete  (lightweight)  (CES  39055) 

9.1975 

Joint  Air  Transport  Establishment,  RAP  Abingdon,  Berks,  UK 
UNPUBLISHED  REPORT 

Abstract : 

Presents  air  drop  tests  of  two  items  of  equipment  on  the  Medium 
Stressed  Fiatform  Mk  3.  The  equipment  tested  were  a  Tool  Kit  GP, 
Engineer,  400  Hz  secured  in  a  Trailer  Cargo  3/4  ton  GS,  and  a  Water 
Pruification  Unit  secured  in- a  Trailer  Cargo  3/4  ton  GS.  Botn 
loads  were  successfully  airdropped  using  the  platform.  Rigging 
and  load  preparation  instructions  for  both  loads  are  given. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


lb  Long-Term  Worldwide  Effects  of  Multiple  Nuclear-Weapons 
Detonations 

1975 

National  Research  Council,  National  Academy  of  Sciences, 

DC ,  USA 

UNPUBLISHED  REPORT 

Abstract : 

The  study  is  concerned  with  the  long-term  effects  on  tne  earth  and 
its  inhabitants  of  a  massive  nuclear  exchange  involving  10,000 
megatons  of  TNT  equivalent,  and  assuming  the  detonations  would 
take  place  in  the  northern  hemisphere.  The  study  was  confined  to 
pnenomena  occurring  at  distance  of  the  order  of  continental 
separations  from  the  detonations,  the  effects  of  which  might  be 
evident  up  to  30  years  after  their  occurrence.  Topics  covered 
include  atmospheric  effects,  effects  on  natural  and  managed 
terrestrial  ecosystems,  effects  on  the  aquatic  environment,  and 
somatic  and  genetic  effects  on  humans. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 
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17  Computer  Method  for  Optimizing  Nuclear  Snielding  of  Combat 
Venicles 

R  W  Birkhahn,  £  H  Brehm 

197.' 

Bundesminister  aer  Verteidigung,  ForsonBer,  Germany 
UNPUBLISHED  REPORT 

Abstract : 

A  computer  code  has  been  developed  for  the  design  of  optimum 
snielding  of  combat  vehicles  operating  in  conditions  of  nuclear 
radiation.  Using  exponential  attenuation  formulae,  guidelines  ar 
given  for  the  design  of  shielding. 

Descriptors:  Selected  from  TEST/DRIT  (ir.  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


IS  Parametric  Study  of  the  Initial  detection  Ranges  Needed  lor 
Anti  Submarine  Warfare  Defence  cf  a  Force  against  Missile 
and  Torpedo-Firing  Submarines 

R  A  Kencroft 

974 

Admiralty  Research  Laboratory,  Teddir.gton,  Middlesex,  UK 
UNPUBLISHED  REPORT 

Abstract: 

Describes  a  simple  analytical  examination  into  the  most  fundamental 
aspect  in  the  defence  of  a  force  in  transit  whicn  is  tne  relation¬ 
ship  between  the  kinematics  of  tne  system  and  detection  range. 
Changes  in  various  parameters  are  measured  in  terms  of  the  required 
detection  range  and  special  attention  is  focussed  upon  the  speed  of 
the  relocating  vehicle.  The  results  show  how  the  manoeuvrability  o 
th.e  force  can  dominate  other  factors.  Finally  there  are  examples 
of  closure  times  and  how  the  attacker's  weapon  parameters  can 
influence  his  angle  of  approach. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 
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1v  Examination  of  the  Energy  Transportation  Security  net  of  isr;;* 

A  Baiilie 
9.1974 

Tetra  Tech  Inc,  Arlington  Va,  USA 
UNPUBLISHED  RZr’OkT 

Abstract : 

Tne  Act,  which  would  require  that  a  specified  percentage  of  imported 
oil  be  carried  on  privately-owned  US-flag  commercial  vessels,  has 
been  reintroduced  in  the  94th  Congress  and  eventual  passage  is 
anticipated.  Tnis  paper  examines  the  various  issues  raised  by  tne 
Act.  The  enactment  of  cargo  preference  is  justifiable  primarily  or. 
tne  basis  of  national  security  requirements  arid  benefit  to  the  mer- 
cnant  marine.  Off-setting  cost  provisions  are  of  interest  because 
of  potential  inflationary  impact  and  other  provisions  raise 
ancillary  issues  of  lesser  import.  The  national  security  require¬ 
ment  and  tne  merchant  marine  benefit  are  not  conclusively  supported, 
at  best,  and  are  of  marginal  validity,  at  worst.  Clearly,  the 
burden  of  further  support  and  increased  validity  is  on  tne  pro¬ 
ponents  of  the  Act. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


20  Derivation  of  CARP  Tables 
D  Otridge,  K  R  Nash 
2.19?*+ 

Joint  h.ir  Transport  Establishment ,  RAF  Roingdor.,  Berk;:,  UK 
UNPUBLISHED  REPORT 

Abstract : 

Ar.  explanation  is  given  of  Computed  Air  Release  Point  (CARP) 
tables  and  their  derivation,  with  special  application  to  the 
production  of  figures  for  new  stores.  Lata  required  and  calcula¬ 
tions  necessary  for  any  new  store  or  parachute  are  presented. 

Tne  computation  of  store  drop  factors  and  stick  lengths  are  also 
considered.  For  main  report  see  Ref  21. 

Descriptors:  Selected  from  TEST/DRIT( ( in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


21  Review  of  CARP  Tables 


D  Otridge,  K  R  Nash 
11.1973 

Joint  air  Transport  Establismient,  RAF  Abingdor.,  Berks,  UK 
UNPU3LISHEL  REPORT 

Abstract : 

A  review  of  Computed  Air  Release  Point  (CARP)  tables  has  beer,  made 
to  include  recently  introduced  dropping  systems  and  reduced 
dropping  heights.  Tables  for  SSL  Mks  I  and  II,  22  ft  steerable 
parachutes  were  derived.  The  review  was  extended  to  include  Lrop 
Zone  probability  criteria.  For  Addendum,  see  Ref  20. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


22  Brief  Review  of  Bone  Air-to-Air  Models 
L  B  Anderson 
S.1972 

Institute  lor  defense  Anr-iysis,  *r:  cr.rvcr.,  Vs,  USA 
UNPUBLISHED  REPORT 

Abstract: 

Metnoas  for  assessing  attrition  in  air  to  air  engagements  are 
reviewed.  Deterministic  and  expected  value  models  are  considered 
Among  tne  models  discussed  are  Lanchester  equations,  UACAM-1  anc’ 
TAG  CONTENDER.  Brief  consideration  is  given  to  some  other  models 
in  addition. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


N 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  tnese 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


23 


Task  of  Producing  an  Approved  Lesion  to  Meet  tne  Operational 
Requirement  with  Particular  Reference  to  quality  of  Design 
Matters 

D  B  Geake 

10.197' 

Procurement  Executive,  Ministry  of  Defence,  UK 
UNPUBLISHED  REPORT 


Abstract : 

Tasks  involved  in  achieving  quality  and  reliability  to  meet  the 
operational  requirements  for  defence  equipment  are  described. 
Particular  emphasis  is  given  to  the  arrangements  whicr.  must  be 
made  during  the  research  and* development  stages,  including  principle 
features  such  as,  reliability  requirements  in  guided  weapons, 
management  of  projects,  quality  assurance  plans,  configuration 
control,  test  plans,  etc.  These  stages  are  discussed  with  present 
policy  in  mine  together  with  observations  on  tne  important  role 
of  management  in  achieving  reliability  and  quality  in  tne  production 
of  defence  equipment. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  01  of  equal 
relevance? 


-157- 


24  Low  Cost  Ai-frame  Design  Studies  for  an  Expendable  Air- 
Launchec  Cruise  Venicle 

A  3  Price,  J  A  Heinricns 

4. 1°7C 

Martin-Marietta  Corp,  Baltimore,  USA 
UNPUBLISHED  REPORT 

Abstract : 

A  study  was  made  of  a  new  and  potentially  loner  cost  materials  anc 
methods  for  fabricating  airframes  for  expendable  flignt  vehicles. 
Alternate  construction  methods  were  evaluated  primarily  on  the 
basis  of  cost,  once  functional  adequacy  was  determined  and  specifi 
methods  of  construction  were  recommended  for  the  major  vehicle 
sections.  In  all  cases,  new  design  concepts  were  related  to 
conventional  sheet  metal  designs.  Significant  reductions  in  air¬ 
frame  fabrication  costs  are  shown  to  be  possible  through  the  use  of 
plastic  materials  and  their  high  rate  processing  methods. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  oi  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


25  Metnod  of  Calculating  Casualties  frora  Atomic  olast  in 
a  City 

J  L  Taylor 

".I960 

Department  of  National  Defence,  Operational  Resenrcn  Division 
Canada 

UNPUBLISHED  REPOiiT 

Abstract : 

Simple  formulae  are  derived  for  the  percentage  of  casualties 
caused  by  an  accurately  aimed  or  inaccurately  aimed  bomb,  on  the 
assumption  that  population  is  distributed  about  tne  city  centre 
witn  a  circular  normal  distribution,  and  that  tne  chance  of  becom¬ 
ing  a  casualty  is  distributed  with  a  circular  normal  distribution 
about  the  centres  of  burst.  Empirical  formulae  are  derived  to 
estimate  cumulative  effect  from  two  or  more  bombs  when  separate 
aiming  points  are  chosen  to  maximise  kills.  Although  the  formulae 
are  believed  to  be  sufficiently  accurate  for  many  purposes,  it  is 
also  shown  how  greater  accuracy  may  be  acnieved  witn  the  same 
formulae,  by  using  linear  combinations  of  normal  curves  to  approxi 
mate  more  closely  to  the  population  distribution  and  the  kill 
probability  distance  curves. 

Descriptors:  Selected  from  TEST/DRIT  (in  order  of  relevance) 


Additional  descriptors  (not  in  thesaurus)  (in  order  of  relevance) 


When  compared  with  the  descriptors  from  the  thesaurus,  are  these 
additional  descriptors  more  relevant,  less  relevant,  or  of  equal 
relevance? 


T E3T/DAIT  Comparison 
Questionnaire 


Wnich  i'aesaurus  did  you  preier  using'. 

(delete  as  necessary) 


3  What  did  you  dislike  about  the  other  thesaurus? 
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Use  of  Impermeable  r.ukluks  in  trie  Cold.  «i.  Initia 


Investigation 

A3SA33IN 

Canodi  nr. 

Cold 

Comfort 

Drying 

Foot 

Footwear 

Forces 

TEST 

Footwear 
•Mukluks 
Arctic  clothing 
Permeability 
Cold  weather  tests 

BRIT 

Shoes 

Footwear 

•Mukluks 

Permeability 

Moisture 

Cold  weather  tests 


Impermeable 

Moisture 

Muk 1uks 

Permeac.e 

Persipiration 

Trials 

Winter 


Drying 
Perspi ration 
Protective  clothing 
Performance  tests 
Protection 


Materials 

Drying 

Materials 

Experimental  design 
Laboratory  tests 
Field  tests 


2  Experimental  Trial  of  a  Temperate  Zone  Winter  Flying  Boot 
Aircrew  Equipment  Research  and  Development  Committee  Tria 


ASSASSIN 

Aircrew 

Boot 

Design 

Development 

TEST 

Boots  (footwear) 
Flight  clothing 
Protective  clothing 
Performance  tests 
Environmental  tests 

DRIT 

•Boots 
Footwear 
Flight  clothing 
Protective  clothing 
Environmental  tests 
•Evaluation 


Flying 

Temperate 

Trial 

Winter 

Zone 

Evaluation 
Temperate  regions 
Winter 

Human  factors  engineering 
Design 


Acceptance  tests 
•Performance  tests 
Temperate  regions 
Winter 

Human  factors  engineering 
Design 


3 


Final  Tecnr.icul  Report  on  Ocean  Surveillance  Inforrratior 
System  Masterplan 


ASSASSIN 

Command 

Control 

Development 

Engineering 

Information 

Masterplan 

TEST 

•OSIS 

•Masterplan 
Ocean  surveillance 
Information  systems 
Command  and  control 

DRIT 

•OSIS 

•Masterplan 
Ocean  surveillance 
Information  systems 


Ocean 

OSIS 

Shipboard 

Surveillance 

System 


Naval  operations 
•Shipboard  equipment 
Systems  engineering 
Development 


Command  and  Control  systems 
Tactical  warfare 
Systems  engineering 
Planning 


4 


Crisis  Warning  and  Management 


assassin 

Cninese 

Conflict 

CREON 

Crisis 

Decision 


TEST 

•Crises 

Political  sciences 
Political  intelligence 
Political  warfare 
International  relations 


DRIT 

Emergencies 
Political  science 
Conflict 
Behavioour 
Nations 


Literature 

Management 

Survey 

Warning 


•China 
Monitors 
Warning  systems 
Forecasting 
Trends 


China 

Decision  making 
Warning  systems 
Forecasting 
•Trends 


PVW  T4.»VT-' s”  11 

». 

S  Study  Using  Infrared  Tnenaography  of  Ulotninr  Assemblies 

for  Use  by  Personnel 

working  beneath  Operating  Helicopters 

f'S- 

v-'.' 

ASSHOiN 

• 

C-otninn 

uperat-or.s 

VV.''- 

Down-draugnt 

Personne* 

Heat 

Surface 

Kelicopten 

Tempe rature 

• 

Hovering 

Thermography 

>/• 

Infrared 

Working 

Measurements 

Worn 

•V 

•1 

PS 

TEST 

5  1 

Protective  clothing 

Thermal  insulation 

m 

•Ground  crews 

Body  temperature 

•*%< 

-*■  -w 

§1 

m 

Flight  crews 

Heat  loss 

,  * 

S|| 

Helicopters 

Temperature  measurement 

■S 

Sh 

Hovering 

Thermography 

m 

Downwash 

Windchill 

Infrared  radiation 

9} 

EBIT 

Protective  clothing 

Ground  crews 

Helicopters 

Hovering 

Downwash 

Personnel 

Human  body 

Heat 


Heat  loss 
Temperature 
Heat  transfer 
Measurement 
Thermography 
Infrared  radiation 
Infrared  detection 
Ground  level 


%  J 
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Study  Based  oi:  tne  Problems  of  Electronic  Warfare  in  a 
Typical  Situation  of  an  Aerial  AttacK  on  a  Target  at  Sea 


ASSASSIN 

Aerial 

Ai rcraft 

Analysis 

Armament 

Assault 

Attack 

Conflicts 

Consequences 

Disturbances 

Interference 

Electronic 

Electronic-countermeasures 
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